Jul 27 17:55:14 user nova-compute[71206]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 27 17:55:17 user nova-compute[71206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71206) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71206) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71206) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 17:55:17 user nova-compute[71206]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:55:17 user nova-compute[71206]: INFO nova.virt.driver [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 27 17:55:17 user nova-compute[71206]: INFO nova.compute.provider_config [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Acquiring lock "singleton_lock" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Acquired lock "singleton_lock" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Releasing lock "singleton_lock" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Full set of CONF: {{(pid=71206) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ******************************************************************************** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Configuration options gathered from: {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ================================================================================ {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] allow_resize_to_same_host      = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] arq_binding_timeout            = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] backdoor_port                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] backdoor_socket                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] block_device_allocate_retries  = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] block_device_allocate_retries_interval = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cert                           = self.pem {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute_monitors               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] config_dir                     = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] config_drive_format            = iso9660 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] config_source                  = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] console_host                   = user {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] control_exchange               = nova {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cpu_allocation_ratio           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] daemon                         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] debug                          = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] default_access_ip_network_name = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] default_availability_zone      = nova {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] default_ephemeral_format       = ext4 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] default_schedule_zone          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] disk_allocation_ratio          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] enable_new_services            = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] enabled_ssl_apis               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] flat_injected                  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] force_config_drive             = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] force_raw_images               = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] graceful_shutdown_timeout      = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] heal_instance_info_cache_interval = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] host                           = user {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_build_timeout         = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_delete_interval       = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_name_template         = instance-%08x {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_usage_audit           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_usage_audit_period    = month {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] internal_service_availability_zone = internal {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] key                            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] live_migration_retry_count     = 30 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_config_append              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_dir                        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_file                       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_options                    = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_rotate_interval            = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_rotate_interval_type       = days {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] log_rotation_type              = none {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] long_rpc_timeout               = 1800 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_concurrent_builds          = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_concurrent_live_migrations = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_concurrent_snapshots       = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_local_block_devices        = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_logfile_count              = 30 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] max_logfile_size_mb            = 200 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] maximum_instance_delete_attempts = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metadata_listen                = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metadata_listen_port           = 8775 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metadata_workers               = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] migrate_max_retries            = -1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] mkisofs_cmd                    = genisoimage {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] my_ip                          = 10.0.0.210 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] network_allocate_retries       = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] osapi_compute_listen_port      = 8774 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] osapi_compute_unique_server_name_scope =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] osapi_compute_workers          = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] password_length                = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] periodic_enable                = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] periodic_fuzzy_delay           = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] pointer_model                  = ps2mouse {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] preallocate_images             = none {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] publish_errors                 = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] pybasedir                      = /opt/stack/nova {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ram_allocation_ratio           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rate_limit_burst               = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rate_limit_except_level        = CRITICAL {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rate_limit_interval            = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reboot_timeout                 = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reclaim_instance_interval      = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] record                         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reimage_timeout_per_gb         = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] report_interval                = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rescue_timeout                 = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reserved_host_cpus             = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reserved_host_disk_mb          = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reserved_host_memory_mb        = 512 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] reserved_huge_pages            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] resize_confirm_window          = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] resize_fs_using_block_device   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] resume_guests_state_on_host_boot = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rpc_response_timeout           = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] run_external_periodic_tasks    = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] running_deleted_instance_action = reap {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] running_deleted_instance_timeout = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler_instance_sync_interval = 120 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_down_time              = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] servicegroup_driver            = db {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] shelved_offload_time           = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] shelved_poll_interval          = 3600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] shutdown_timeout               = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] source_is_ipv6                 = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ssl_only                       = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] state_path                     = /opt/stack/data/nova {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] sync_power_state_interval      = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] sync_power_state_pool_size     = 1000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] syslog_log_facility            = LOG_USER {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] tempdir                        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] timeout_nbd                    = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] transport_url                  = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] update_resources_interval      = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_cow_images                 = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_eventlog                   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_journal                    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_json                       = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_rootwrap_daemon            = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_stderr                     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] use_syslog                     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vcpu_pin_set                   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plugging_is_fatal          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plugging_timeout           = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] virt_mkfs                      = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] volume_usage_poll_interval     = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] watch_log_file                 = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] web                            = /usr/share/spice-html5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_concurrency.disable_process_locking = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.auth_strategy              = keystone {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.compute_link_prefix        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.dhcp_domain                = novalocal {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.enable_instance_password   = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.glance_link_prefix         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.instance_list_per_project_cells = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.list_records_by_skipping_down_cells = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.local_metadata_per_cell    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.max_limit                  = 1000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.metadata_cache_expiration  = 15 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.neutron_default_tenant_id  = default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.use_forwarded_for          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.use_neutron_default_nets   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_dynamic_targets = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_jsonfile_path   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.backend_argument         = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.config_prefix            = cache.oslo {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.dead_timeout             = 60.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.debug_cache_backend      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.enable_retry_client      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.enable_socket_keepalive  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.enabled                  = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.expiration_time          = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.hashclient_retry_attempts = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_dead_retry      = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_password        =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_sasl_enabled    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.memcache_username        =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.proxies                  = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.retry_attempts           = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.retry_delay              = 0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.socket_keepalive_count   = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.socket_keepalive_idle    = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.socket_keepalive_interval = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.tls_allowed_ciphers      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.tls_cafile               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.tls_certfile             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.tls_enabled              = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cache.tls_keyfile              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.auth_section            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.auth_type               = password {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.cafile                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.certfile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.collect_timing          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.cross_az_attach         = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.debug                   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.endpoint_template       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.http_retries            = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.insecure                = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.keyfile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.os_region_name          = RegionOne {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.split_loggers           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cinder.timeout                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.cpu_dedicated_set      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.cpu_shared_set         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.image_type_exclude_list = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.resource_provider_association_refresh = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.shutdown_retry_interval = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] conductor.workers              = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] console.allowed_origins        = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] console.ssl_ciphers            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] console.ssl_minimum_version    = default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] consoleauth.token_ttl          = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.cafile                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.certfile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.collect_timing          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.connect_retries         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.connect_retry_delay     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.endpoint_override       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.insecure                = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.keyfile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.max_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.min_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.region_name             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.service_name            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.service_type            = accelerator {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.split_loggers           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.status_code_retries     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.timeout                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] cyborg.version                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.backend               = sqlalchemy {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.connection            = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.connection_debug      = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.connection_parameters =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.connection_recycle_time = 3600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.connection_trace      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.db_inc_retry_interval = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.db_max_retries        = 20 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.db_max_retry_interval = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.db_retry_interval     = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.max_overflow          = 50 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.max_pool_size         = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.max_retries           = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.mysql_enable_ndb      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.mysql_wsrep_sync_wait = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.pool_timeout          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.retry_interval        = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.slave_connection      = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] database.sqlite_synchronous    = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.backend           = sqlalchemy {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.connection        = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.connection_debug  = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.connection_parameters =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.connection_recycle_time = 3600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.connection_trace  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.db_inc_retry_interval = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.db_max_retries    = 20 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.db_max_retry_interval = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.db_retry_interval = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.max_overflow      = 50 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.max_pool_size     = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.max_retries       = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.mysql_enable_ndb  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.pool_timeout      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.retry_interval    = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.slave_connection  = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] api_database.sqlite_synchronous = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] devices.enabled_mdev_types     = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ephemeral_storage_encryption.enabled = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.api_servers             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.cafile                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.certfile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.collect_timing          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.connect_retries         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.connect_retry_delay     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.debug                   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.default_trusted_certificate_ids = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.enable_certificate_validation = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.enable_rbd_download     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.endpoint_override       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.insecure                = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.keyfile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.max_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.min_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.num_retries             = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.rbd_ceph_conf           =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.rbd_connect_timeout     = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.rbd_pool                =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.rbd_user                =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.region_name             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.service_name            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.service_type            = image {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.split_loggers           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.status_code_retries     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.timeout                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.verify_glance_signatures = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] glance.version                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] guestfs.debug                  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.config_drive_cdrom      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.config_drive_inject_password = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.enable_remotefx         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.instances_path_share    =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.limit_cpu_features      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.use_multipath_io        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.vswitch_name            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] mks.enabled                    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.manager_interval   = 2400 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.precache_concurrency = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.remove_unused_base_images = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] image_cache.subdirectory_name  = _base {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.api_max_retries         = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.api_retry_interval      = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.auth_section            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.auth_type               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.cafile                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.certfile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.collect_timing          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.connect_retries         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.connect_retry_delay     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.endpoint_override       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.insecure                = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.keyfile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.max_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.min_version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.partition_key           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.peer_list               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.region_name             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.serial_console_state_timeout = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.service_name            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.service_type            = baremetal {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.split_loggers           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.status_code_retries     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.timeout                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ironic.version                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] key_manager.fixed_key          = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.barbican_api_version  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.barbican_endpoint     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.barbican_endpoint_type = public {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.barbican_region_name  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.cafile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.certfile              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.collect_timing        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.insecure              = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.keyfile               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.number_of_retries     = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.retry_delay           = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.send_service_user_token = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.split_loggers         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.timeout               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.verify_ssl            = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican.verify_ssl_path       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.auth_section = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.auth_type = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.cafile   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.certfile = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.collect_timing = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.insecure = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.keyfile  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.split_loggers = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] barbican_service_user.timeout  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.approle_role_id          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.approle_secret_id        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.cafile                   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.certfile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.collect_timing           = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.insecure                 = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.keyfile                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.kv_mountpoint            = secret {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.kv_version               = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.namespace                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.root_token_id            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.split_loggers            = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.ssl_ca_crt_file          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.timeout                  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.use_ssl                  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.cafile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.certfile              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.collect_timing        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.connect_retries       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.connect_retry_delay   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.endpoint_override     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.insecure              = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.keyfile               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.max_version           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.min_version           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.region_name           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.service_name          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.service_type          = identity {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.split_loggers         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.status_code_retries   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.timeout               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] keystone.version               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.connection_uri         =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_mode               = custom {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: WARNING oslo_config.cfg [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_power_governor_high = performance {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_power_management   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.device_detach_attempts = 8 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.device_detach_timeout  = 20 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.disk_cachemodes        = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.disk_prefix            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.enabled_perf_events    = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.file_backed_memory     = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.gid_maps               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.hw_disk_discard        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.hw_machine_type        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_rbd_pool        = rbd {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_type            = default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.images_volume_group    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.inject_key             = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.inject_partition       = -2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.inject_password        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.iscsi_iface            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.iser_use_multipath     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_downtime = 500 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_inbound_addr = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_scheme  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_timeout_action = abort {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_tunnelled = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: WARNING oslo_config.cfg [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 27 17:55:17 user nova-compute[71206]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 27 17:55:17 user nova-compute[71206]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 27 17:55:17 user nova-compute[71206]: and ``live_migration_inbound_addr`` respectively.
Jul 27 17:55:17 user nova-compute[71206]: ).  Its value may be silently ignored in the future.
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.live_migration_with_native_tls = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.max_queues             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.nfs_mount_options      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_pcie_ports         = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.pmem_namespaces        = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.quobyte_client_cfg     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rbd_secret_uuid        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rbd_user               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rescue_image_id        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rescue_kernel_id       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.rx_queue_size          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.smbfs_mount_options    =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.snapshot_compression   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.snapshot_image_format  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.sparse_logical_volumes = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.swtpm_enabled          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.swtpm_group            = tss {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.swtpm_user             = tss {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.sysinfo_serial         = unique {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.tb_cache_size          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.tx_queue_size          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.uid_maps               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.use_virtio_for_bridges = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.virt_type              = kvm {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.volume_clear           = zero {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.volume_clear_size      = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.volume_use_multipath   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_cache_path   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.auth_section           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.auth_type              = password {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.cafile                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.certfile               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.collect_timing         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.connect_retries        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.connect_retry_delay    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.default_floating_pool  = public {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.endpoint_override      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.extension_sync_interval = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.http_retries           = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.insecure               = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.keyfile                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.max_version            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.min_version            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.ovs_bridge             = br-int {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.physnets               = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.region_name            = RegionOne {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.service_metadata_proxy = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.service_name           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.service_type           = network {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.split_loggers          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.status_code_retries    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.timeout                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] neutron.version                = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] notifications.bdms_in_notifications = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] notifications.default_level    = INFO {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] notifications.notification_format = unversioned {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] notifications.notify_on_state_change = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] pci.alias                      = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] pci.device_spec                = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] pci.report_in_placement        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.auth_section         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.auth_type            = password {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.cafile               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.certfile             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.collect_timing       = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.connect_retries      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.connect_retry_delay  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.default_domain_id    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.default_domain_name  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.domain_id            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.domain_name          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.endpoint_override    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.insecure             = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.keyfile              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.max_version          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.min_version          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.password             = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.project_domain_id    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.project_domain_name  = Default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.project_id           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.project_name         = service {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.region_name          = RegionOne {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.service_name         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.service_type         = placement {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.split_loggers        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.status_code_retries  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.system_scope         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.timeout              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.trust_id             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.user_domain_id       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.user_domain_name     = Default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.user_id              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.username             = placement {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] placement.version              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.cores                    = 20 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.count_usage_from_placement = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.injected_file_content_bytes = 10240 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.injected_file_path_length = 255 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.injected_files           = 5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.instances                = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.key_pairs                = 100 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.metadata_items           = 128 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.ram                      = 51200 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.recheck_quota            = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.server_group_members     = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] quota.server_groups            = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rdp.enabled                    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.image_metadata_prefilter = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.max_attempts         = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.max_placement_results = 1000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] scheduler.workers              = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.host_subset_size = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.isolated_hosts = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.isolated_images = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.pci_in_placement = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.track_instance_changes = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metrics.required               = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metrics.weight_multiplier      = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] metrics.weight_setting         = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.enabled         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.port_range      = 10000:20000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] serial_console.serialproxy_port = 6083 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.auth_section      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.auth_type         = password {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.cafile            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.certfile          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.collect_timing    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.insecure          = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.keyfile           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.send_service_user_token = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.split_loggers     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] service_user.timeout           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.agent_enabled            = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.enabled                  = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.html5proxy_port          = 6082 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.image_compression        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.jpeg_compression         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.playback_compression     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.server_listen            = 127.0.0.1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.streaming_mode           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] spice.zlib_compression         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] upgrade_levels.baseapi         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] upgrade_levels.cert            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] upgrade_levels.compute         = auto {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] upgrade_levels.conductor       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] upgrade_levels.scheduler       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.cafile = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.certfile = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.insecure = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vendordata_dynamic_auth.timeout = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.api_retry_count         = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.ca_file                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.cache_prefix            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.cluster_name            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.connection_pool_size    = 10 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.console_delay_seconds   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.datastore_regex         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.host_ip                 = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.host_password           = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.host_port               = 443 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.host_username           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.insecure                = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.integration_bridge      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.maximum_objects         = 100 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.pbm_default_policy      = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.pbm_enabled             = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.pbm_wsdl_location       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.serial_port_proxy_uri   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.serial_port_service_uri = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.task_poll_interval      = 0.5 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.use_linked_clone        = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.vnc_keymap              = en-us {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.vnc_port                = 5900 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vmware.vnc_port_total          = 10000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.auth_schemes               = ['none'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.enabled                    = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.novncproxy_port            = 6080 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.vencrypt_ca_certs          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.vencrypt_client_cert       = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vnc.vencrypt_client_key        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.disable_rootwrap   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.enable_numa_live_migration = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.libvirt_disable_apic = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.client_socket_timeout     = 900 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.default_pool_size         = 1000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.keep_alive                = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.max_header_line           = 16384 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.ssl_ca_file               = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.ssl_cert_file             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.ssl_key_file              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.tcp_keepidle              = 600 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] zvm.ca_file                    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] zvm.cloud_connector_url        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] zvm.reachable_timeout          = 300 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.enforce_new_defaults = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.enforce_scope      = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.policy_default_rule = default {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.connection_string     = messaging:// {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.enabled               = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.es_doc_type           = notification {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.es_scroll_size        = 10000 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.es_scroll_time        = 2m {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.filter_error_trace    = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.hmac_keys             = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.sentinel_service_name = mymaster {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.socket_timeout        = 0.1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.trace_requests        = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler.trace_sqlalchemy      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler_jaeger.process_tags   = {} {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler_jaeger.service_name_prefix = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] profiler_otlp.service_name_prefix = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] remote_debug.host              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] remote_debug.port              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_notifications.retry = -1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.auth_section        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.auth_type           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.cafile              = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.certfile            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.collect_timing      = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.connect_retries     = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.connect_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.endpoint_id         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.endpoint_override   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.insecure            = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.keyfile             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.max_version         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.min_version         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.region_name         = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.service_name        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.service_type        = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.split_loggers       = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.status_code_retries = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.status_code_retry_delay = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.timeout             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.valid_interfaces    = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_limit.version             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_reports.file_event_handler = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] oslo_reports.log_dir           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.group  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] vif_plug_ovs_privileged.user   = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.isolate_vif         = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] os_brick.lock_path             = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.capabilities   = [21] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.group          = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.helper_command = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] privsep_osbrick.user           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.group           = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.helper_command  = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] nova_sys_admin.user            = None {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG oslo_service.service [None req-f1f2e070-347d-4ee9-b348-53ae43333665 None None] ******************************************************************************** {{(pid=71206) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 27 17:55:17 user nova-compute[71206]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Starting native event thread {{(pid=71206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Starting green dispatch thread {{(pid=71206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Starting connection event dispatch thread {{(pid=71206) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Connecting to libvirt: qemu:///system {{(pid=71206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0e2e7a37c0> {{(pid=71206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0e2e7a37c0> {{(pid=71206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 27 17:55:17 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Connection event '1' reason 'None'
Jul 27 17:55:17 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 17:55:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.mount [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Initialising _HostMountState generation 0 {{(pid=71206) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host capabilities <capabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <host>
Jul 27 17:55:25 user nova-compute[71206]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 27 17:55:25 user nova-compute[71206]:     <cpu>
Jul 27 17:55:25 user nova-compute[71206]:       <arch>x86_64</arch>
Jul 27 17:55:25 user nova-compute[71206]:       <model>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <microcode version='1070'/>
Jul 27 17:55:25 user nova-compute[71206]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='osxsave'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='invtsc'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='rsba'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature name='skip-l1dfl-vmentry'/>
Jul 27 17:55:25 user nova-compute[71206]:       <pages unit='KiB' size='4'/>
Jul 27 17:55:25 user nova-compute[71206]:       <pages unit='KiB' size='2048'/>
Jul 27 17:55:25 user nova-compute[71206]:     </cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <power_management>
Jul 27 17:55:25 user nova-compute[71206]:       <suspend_mem/>
Jul 27 17:55:25 user nova-compute[71206]:       <suspend_disk/>
Jul 27 17:55:25 user nova-compute[71206]:       <suspend_hybrid/>
Jul 27 17:55:25 user nova-compute[71206]:     </power_management>
Jul 27 17:55:25 user nova-compute[71206]:     <iommu support='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <migration_features>
Jul 27 17:55:25 user nova-compute[71206]:       <live/>
Jul 27 17:55:25 user nova-compute[71206]:       <uri_transports>
Jul 27 17:55:25 user nova-compute[71206]:         <uri_transport>tcp</uri_transport>
Jul 27 17:55:25 user nova-compute[71206]:         <uri_transport>rdma</uri_transport>
Jul 27 17:55:25 user nova-compute[71206]:       </uri_transports>
Jul 27 17:55:25 user nova-compute[71206]:     </migration_features>
Jul 27 17:55:25 user nova-compute[71206]:     <topology>
Jul 27 17:55:25 user nova-compute[71206]:       <cells num='2'>
Jul 27 17:55:25 user nova-compute[71206]:         <cell id='0'>
Jul 27 17:55:25 user nova-compute[71206]:           <memory unit='KiB'>8189224</memory>
Jul 27 17:55:25 user nova-compute[71206]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 27 17:55:25 user nova-compute[71206]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 17:55:25 user nova-compute[71206]:           <distances>
Jul 27 17:55:25 user nova-compute[71206]:             <sibling id='0' value='10'/>
Jul 27 17:55:25 user nova-compute[71206]:             <sibling id='1' value='20'/>
Jul 27 17:55:25 user nova-compute[71206]:           </distances>
Jul 27 17:55:25 user nova-compute[71206]:           <cpus num='6'>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 27 17:55:25 user nova-compute[71206]:           </cpus>
Jul 27 17:55:25 user nova-compute[71206]:         </cell>
Jul 27 17:55:25 user nova-compute[71206]:         <cell id='1'>
Jul 27 17:55:25 user nova-compute[71206]:           <memory unit='KiB'>8206460</memory>
Jul 27 17:55:25 user nova-compute[71206]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 27 17:55:25 user nova-compute[71206]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 17:55:25 user nova-compute[71206]:           <distances>
Jul 27 17:55:25 user nova-compute[71206]:             <sibling id='0' value='20'/>
Jul 27 17:55:25 user nova-compute[71206]:             <sibling id='1' value='10'/>
Jul 27 17:55:25 user nova-compute[71206]:           </distances>
Jul 27 17:55:25 user nova-compute[71206]:           <cpus num='6'>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 27 17:55:25 user nova-compute[71206]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 27 17:55:25 user nova-compute[71206]:           </cpus>
Jul 27 17:55:25 user nova-compute[71206]:         </cell>
Jul 27 17:55:25 user nova-compute[71206]:       </cells>
Jul 27 17:55:25 user nova-compute[71206]:     </topology>
Jul 27 17:55:25 user nova-compute[71206]:     <cache>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 27 17:55:25 user nova-compute[71206]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 27 17:55:25 user nova-compute[71206]:     </cache>
Jul 27 17:55:25 user nova-compute[71206]:     <secmodel>
Jul 27 17:55:25 user nova-compute[71206]:       <model>apparmor</model>
Jul 27 17:55:25 user nova-compute[71206]:       <doi>0</doi>
Jul 27 17:55:25 user nova-compute[71206]:     </secmodel>
Jul 27 17:55:25 user nova-compute[71206]:     <secmodel>
Jul 27 17:55:25 user nova-compute[71206]:       <model>dac</model>
Jul 27 17:55:25 user nova-compute[71206]:       <doi>0</doi>
Jul 27 17:55:25 user nova-compute[71206]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 27 17:55:25 user nova-compute[71206]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 27 17:55:25 user nova-compute[71206]:     </secmodel>
Jul 27 17:55:25 user nova-compute[71206]:   </host>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='alpha'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>clipper</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='armv6l'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>spitz</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>nuri</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>kzm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>z2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>tosa</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n810</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>terrier</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>midway</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>microbit</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>verdex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>highbank</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>akita</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>connex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>collie</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='armv7l'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>spitz</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>nuri</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>kzm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>z2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>tosa</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n810</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>terrier</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>midway</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>microbit</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>verdex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>highbank</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>akita</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>connex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>collie</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='aarch64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>spitz</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>nuri</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>kzm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>z2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>tosa</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n810</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>n800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>terrier</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>midway</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>microbit</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>verdex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>raspi3b</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>highbank</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>akita</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>connex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>collie</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <acpi default='on' toggle='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='cris'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='i686'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>isapc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>microvm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='kvm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <pae/>
Jul 27 17:55:25 user nova-compute[71206]:       <nonpae/>
Jul 27 17:55:25 user nova-compute[71206]:       <acpi default='on' toggle='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:       <apic default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='m68k'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>an5206</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>q800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>next-cube</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='microblaze'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='microblazeel'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='mips'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>malta</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='mipsel'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>malta</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='mips64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>malta</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>pica61</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>magnum</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='mips64el'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>malta</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>pica61</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>magnum</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='16'>boston</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='ppc'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mac99</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>40p</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>taihu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='ppc64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>taihu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>40p</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mac99</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='ppc64le'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>taihu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>40p</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>mac99</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='riscv32'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='8'>spike</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>opentitan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='8'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='riscv64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='8'>spike</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>shakti_c</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='8'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='s390x'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='sh4'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>shix</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>r2d</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='sh4eb'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>shix</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>r2d</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='sparc'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>SS-5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>SS-20</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>LX</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>SS-4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>SS-10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>Voyager</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='sparc64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sun4u</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>niagara</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>sun4v</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='x86_64'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>64</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='1'>isapc</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>microvm</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='kvm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <acpi default='on' toggle='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:       <apic default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='xtensa'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>sim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>kc705</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ml605</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx200</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx60</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]:   <guest>
Jul 27 17:55:25 user nova-compute[71206]:     <os_type>hvm</os_type>
Jul 27 17:55:25 user nova-compute[71206]:     <arch name='xtensaeb'>
Jul 27 17:55:25 user nova-compute[71206]:       <wordsize>32</wordsize>
Jul 27 17:55:25 user nova-compute[71206]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='4'>sim</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>kc705</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ml605</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>virt</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx200</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>lx60</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 17:55:25 user nova-compute[71206]:       <domain type='qemu'/>
Jul 27 17:55:25 user nova-compute[71206]:     </arch>
Jul 27 17:55:25 user nova-compute[71206]:     <features>
Jul 27 17:55:25 user nova-compute[71206]:       <cpuselection/>
Jul 27 17:55:25 user nova-compute[71206]:       <deviceboot/>
Jul 27 17:55:25 user nova-compute[71206]:       <disksnapshot default='on' toggle='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     </features>
Jul 27 17:55:25 user nova-compute[71206]:   </guest>
Jul 27 17:55:25 user nova-compute[71206]: </capabilities>
Jul 27 17:55:25 user nova-compute[71206]: 
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-i440fx-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>i686</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='255'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'/>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='lm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ide</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-q35-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>i686</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='288'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'/>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='lm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-q35-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>i686</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='288'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'/>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='lm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-i440fx-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>i686</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='255'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'/>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='lm'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ide</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-i440fx-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>x86_64</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='255'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>efi</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='invtsc'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='rsba'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ide</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-q35-6.2</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>x86_64</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='288'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>efi</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='invtsc'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='rsba'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-q35-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>x86_64</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='288'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>efi</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='invtsc'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='rsba'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 27 17:55:25 user nova-compute[71206]: <domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 17:55:25 user nova-compute[71206]:   <domain>kvm</domain>
Jul 27 17:55:25 user nova-compute[71206]:   <machine>pc-i440fx-jammy</machine>
Jul 27 17:55:25 user nova-compute[71206]:   <arch>x86_64</arch>
Jul 27 17:55:25 user nova-compute[71206]:   <vcpu max='255'/>
Jul 27 17:55:25 user nova-compute[71206]:   <iothreads supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:   <os supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='firmware'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>efi</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:     <loader supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>rom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pflash</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='readonly'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>yes</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='secure'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>no</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </loader>
Jul 27 17:55:25 user nova-compute[71206]:   </os>
Jul 27 17:55:25 user nova-compute[71206]:   <cpu>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-passthrough' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='hostPassthroughMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='maximum' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='maximumMigratable'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>on</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>off</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='host-model' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <vendor>Intel</vendor>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ss'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='vmx'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pcid'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='hypervisor'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arat'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='umip'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='md-clear'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='invtsc'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibpb'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='ibrs'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-stibp'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='rsba'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='erms'/>
Jul 27 17:55:25 user nova-compute[71206]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:     <mode name='custom' supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>qemu64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>qemu32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>phenom</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>pentium</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>n270</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm64</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>kvm32</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>coreduo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>core2duo</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>athlon</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Westmere</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Snowridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Skylake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>SandyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Penryn</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G5</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G4</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G3</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Opteron_G2</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Opteron_G1</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>IvyBridge</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Icelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Haswell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Rome</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-Milan</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>EPYC</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Dhyana</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cooperlake</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>Conroe</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='no'>Broadwell</model>
Jul 27 17:55:25 user nova-compute[71206]:       <model usable='yes'>486</model>
Jul 27 17:55:25 user nova-compute[71206]:     </mode>
Jul 27 17:55:25 user nova-compute[71206]:   </cpu>
Jul 27 17:55:25 user nova-compute[71206]:   <memoryBacking supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:     <enum name='sourceType'>
Jul 27 17:55:25 user nova-compute[71206]:       <value>file</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>anonymous</value>
Jul 27 17:55:25 user nova-compute[71206]:       <value>memfd</value>
Jul 27 17:55:25 user nova-compute[71206]:     </enum>
Jul 27 17:55:25 user nova-compute[71206]:   </memoryBacking>
Jul 27 17:55:25 user nova-compute[71206]:   <devices>
Jul 27 17:55:25 user nova-compute[71206]:     <disk supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='diskDevice'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>disk</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cdrom</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>floppy</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>lun</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='bus'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ide</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>fdc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sata</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </disk>
Jul 27 17:55:25 user nova-compute[71206]:     <graphics supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='type'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>sdl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vnc</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>spice</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egl-headless</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </graphics>
Jul 27 17:55:25 user nova-compute[71206]:     <video supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='modelType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>cirrus</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>vmvga</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>qxl</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>none</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>bochs</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>ramfb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </video>
Jul 27 17:55:25 user nova-compute[71206]:     <hostdev supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='mode'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>subsystem</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='startupPolicy'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>default</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>mandatory</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>requisite</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>optional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='subsysType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>usb</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>pci</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>scsi</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='capsType'/>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='pciBackend'/>
Jul 27 17:55:25 user nova-compute[71206]:     </hostdev>
Jul 27 17:55:25 user nova-compute[71206]:     <rng supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtio-non-transitional</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>random</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>egd</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>builtin</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </rng>
Jul 27 17:55:25 user nova-compute[71206]:     <filesystem supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='driverType'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>path</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>handle</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>virtiofs</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </filesystem>
Jul 27 17:55:25 user nova-compute[71206]:     <tpm supported='yes'>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='model'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-tis</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>tpm-crb</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:       <enum name='backendModel'>
Jul 27 17:55:25 user nova-compute[71206]:         <value>passthrough</value>
Jul 27 17:55:25 user nova-compute[71206]:         <value>emulator</value>
Jul 27 17:55:25 user nova-compute[71206]:       </enum>
Jul 27 17:55:25 user nova-compute[71206]:     </tpm>
Jul 27 17:55:25 user nova-compute[71206]:   </devices>
Jul 27 17:55:25 user nova-compute[71206]:   <features>
Jul 27 17:55:25 user nova-compute[71206]:     <gic supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:     <vmcoreinfo supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <genid supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backingStoreInput supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <backup supported='yes'/>
Jul 27 17:55:25 user nova-compute[71206]:     <sev supported='no'/>
Jul 27 17:55:25 user nova-compute[71206]:   </features>
Jul 27 17:55:25 user nova-compute[71206]: </domainCapabilities>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Checking secure boot support for host arch (x86_64) {{(pid=71206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Checking secure boot support for host arch (x86_64) {{(pid=71206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Checking secure boot support for host arch (x86_64) {{(pid=71206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Secure Boot support detected
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] cpu compare xml: <cpu match="exact">
Jul 27 17:55:25 user nova-compute[71206]:   <model>Nehalem</model>
Jul 27 17:55:25 user nova-compute[71206]: </cpu>
Jul 27 17:55:25 user nova-compute[71206]:  {{(pid=71206) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.virt.node [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Generated node identity 4946ae65-5eaf-4acb-8716-957c2a0b018d
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.virt.node [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Wrote node identity 4946ae65-5eaf-4acb-8716-957c2a0b018d to /opt/stack/data/nova/compute_id
Jul 27 17:55:25 user nova-compute[71206]: WARNING nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Compute nodes ['4946ae65-5eaf-4acb-8716-957c2a0b018d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 27 17:55:25 user nova-compute[71206]: WARNING nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 17:55:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:55:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:55:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:55:25 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Hypervisor/Node resource view: name=user free_ram=10913MB free_disk=26.418941497802734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:55:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:55:25 user nova-compute[71206]: WARNING nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] No compute node record for user:4946ae65-5eaf-4acb-8716-957c2a0b018d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4946ae65-5eaf-4acb-8716-957c2a0b018d could not be found.
Jul 27 17:55:25 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Compute node record created for user:user with uuid: 4946ae65-5eaf-4acb-8716-957c2a0b018d
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:55:26 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [req-4f6b7882-f0aa-4303-8136-d9e02b7f3c31] Created resource provider record via placement API for resource provider with UUID 4946ae65-5eaf-4acb-8716-957c2a0b018d and name user.
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71206) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 27 17:55:26 user nova-compute[71206]: INFO nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] kernel doesn't support AMD SEV
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Libvirt baseline CPU <cpu>
Jul 27 17:55:26 user nova-compute[71206]:   <arch>x86_64</arch>
Jul 27 17:55:26 user nova-compute[71206]:   <model>Nehalem</model>
Jul 27 17:55:26 user nova-compute[71206]:   <vendor>Intel</vendor>
Jul 27 17:55:26 user nova-compute[71206]:   <topology sockets="6" cores="1" threads="1"/>
Jul 27 17:55:26 user nova-compute[71206]: </cpu>
Jul 27 17:55:26 user nova-compute[71206]:  {{(pid=71206) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Updated inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Updating resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d generation from 0 to 1 during operation: update_inventory {{(pid=71206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Updating resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d generation from 1 to 2 during operation: update_traits {{(pid=71206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.service [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Creating RPC server for service compute {{(pid=71206) start /opt/stack/nova/nova/service.py:182}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.service [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Join ServiceGroup membership for this service compute {{(pid=71206) start /opt/stack/nova/nova/service.py:199}}
Jul 27 17:55:26 user nova-compute[71206]: DEBUG nova.servicegroup.drivers.db [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71206) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 27 17:55:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:55:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:56:17 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:56:17 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=10251MB free_disk=26.322853088378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:56:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:57:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:57:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:57:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=10228MB free_disk=26.367961883544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:57:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:57:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:57:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:58:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:58:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=10204MB free_disk=26.142017364501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:58:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:58:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:58:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:59:19 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:19 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=9493MB free_disk=26.17310333251953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:59:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:21 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:59:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:31 user nova-compute[71206]: INFO nova.compute.claims [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Claim successful on node user
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Creating image(s)
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "/opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "/opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "/opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:32 user nova-compute[71206]: INFO nova.compute.claims [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Claim successful on node user
Jul 27 17:59:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.policy [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acff3e99b9914903bbc46a86236c161f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df66e0d4db9e4423975377161874c03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.part --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.virt.images [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] 1bb2eba0-b0b8-44c8-a970-d8bda010fff6 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.part /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:32 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.052s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.part /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.converted" returned: 0 in 0.403s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.352s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:33 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp23nbava7/privsep.sock']
Jul 27 17:59:33 user sudo[80436]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp23nbava7/privsep.sock
Jul 27 17:59:33 user sudo[80436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Creating image(s)
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "/opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.policy [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ed5535b566e42f195aebce82e14ced7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72bcdbc35df444c99f3d4045832c9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:33 user nova-compute[71206]: INFO nova.compute.claims [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Claim successful on node user
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:33 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.191s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.compute.claims [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Claim successful on node user
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Creating image(s)
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.policy [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e5a1cc2e1c45c9ae97077decdb228e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5679fcb6cd0d4b6da2908fbf1d225eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.585s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.compute.claims [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Claim successful on node user
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Creating image(s)
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "/opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "/opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "/opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:34 user sudo[80436]: pam_unix(sudo:session): session closed for user root
Jul 27 17:59:34 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Spawned new privsep daemon via rootwrap
Jul 27 17:59:34 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 17:59:34 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 17:59:34 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 27 17:59:34 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80441
Jul 27 17:59:34 user nova-compute[71206]: WARNING oslo_privsep.priv_context [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] privsep daemon already running
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:34 user nova-compute[71206]: WARNING oslo_privsep.priv_context [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] privsep daemon already running
Jul 27 17:59:34 user nova-compute[71206]: WARNING oslo_privsep.priv_context [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] privsep daemon already running
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.policy [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11517efe2d6c4446a70ebee263053835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed96b96d9354c78ad378575a68b98a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.199s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.215s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.189s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.169s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.125s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk 1073741824" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.182s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:35 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Creating image(s)
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.063s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.policy [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83503c246a474fb1b1591c82962b7a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3796621f174ee4850f31a657d13792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.182s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:35 user nova-compute[71206]: INFO nova.compute.claims [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Claim successful on node user
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk 1073741824" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.462s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Cannot resize image /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.objects.instance [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'migration_context' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.196s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Ensure instance console log exists: /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Successfully created port: e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Successfully created port: 8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.193s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk 1073741824" returned: 0 in 0.055s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.737s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Cannot resize image /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lazy-loading 'migration_context' on Instance uuid eab112a5-6c8d-4d54-86f9-15e28491d037 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Ensure instance console log exists: /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk 1073741824" returned: 0 in 0.040s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.473s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Cannot resize image /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'migration_context' on Instance uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.832s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.188s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:36 user nova-compute[71206]: INFO nova.compute.claims [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Claim successful on node user
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk 1073741824" returned: 0 in 0.054s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Cannot resize image /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'migration_context' on Instance uuid db540ca5-3de8-47c3-968d-402bf58f5d6f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.128s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Creating image(s)
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Cannot resize image /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Ensure instance console log exists: /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.119s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.439s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:37 user nova-compute[71206]: INFO nova.compute.claims [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Claim successful on node user
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.policy [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fa4ebea12dd4e89b0ae6097aae1bb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f383884701844a8b955177235bbbd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk 1073741824" returned: 0 in 0.053s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Creating image(s)
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Cannot resize image /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'migration_context' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Successfully created port: 41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.220s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.policy [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e118a0a4fcb49b185eb68e74988195f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df9d3feea7c4d069de51b33ff29ce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.207s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk 1073741824" returned: 0 in 0.067s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.052s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Cannot resize image /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'migration_context' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Ensure instance console log exists: /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:59:38 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Creating image(s)
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.policy [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83503c246a474fb1b1591c82962b7a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3796621f174ee4850f31a657d13792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk 1073741824" returned: 0 in 0.045s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Successfully updated port: 8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquired lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:59:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Cannot resize image /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Successfully created port: cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Ensure instance console log exists: /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-changed-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Refreshing instance network info cache due to event network-changed-8b34c85b-523a-4a6e-acb0-a4863920df9b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] Acquiring lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:39 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Successfully created port: 9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updating instance_info_cache with network_info: [{"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Releasing lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Instance network_info: |[{"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] Acquired lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.neutron [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Refreshing network info cache for port 8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Start _get_guest_xml network_info=[{"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1998307430',display_name='tempest-ServersNegativeTestJSON-server-1998307430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1998307430',id=1,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-8woyzh0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:32Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=db540ca5-3de8-47c3-968d-402bf58f5d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'pci_devices' on Instance uuid db540ca5-3de8-47c3-968d-402bf58f5d6f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:40 user nova-compute[71206]:   <uuid>db540ca5-3de8-47c3-968d-402bf58f5d6f</uuid>
Jul 27 17:59:40 user nova-compute[71206]:   <name>instance-00000001</name>
Jul 27 17:59:40 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:40 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:40 user nova-compute[71206]:   <metadata>
Jul 27 17:59:40 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:40 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:name>tempest-ServersNegativeTestJSON-server-1998307430</nova:name>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:40</nova:creationTime>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:40 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:40 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:user uuid="acff3e99b9914903bbc46a86236c161f">tempest-ServersNegativeTestJSON-1056680897-project-member</nova:user>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:project uuid="df66e0d4db9e4423975377161874c03a">tempest-ServersNegativeTestJSON-1056680897</nova:project>
Jul 27 17:59:40 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:40 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:40 user nova-compute[71206]:         <nova:port uuid="8b34c85b-523a-4a6e-acb0-a4863920df9b">
Jul 27 17:59:40 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:59:40 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:40 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:40 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:40 user nova-compute[71206]:   </metadata>
Jul 27 17:59:40 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:40 user nova-compute[71206]:     <system>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="serial">db540ca5-3de8-47c3-968d-402bf58f5d6f</entry>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="uuid">db540ca5-3de8-47c3-968d-402bf58f5d6f</entry>
Jul 27 17:59:40 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:40 user nova-compute[71206]:     </system>
Jul 27 17:59:40 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:40 user nova-compute[71206]:   <os>
Jul 27 17:59:40 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:40 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:40 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:40 user nova-compute[71206]:   </os>
Jul 27 17:59:40 user nova-compute[71206]:   <features>
Jul 27 17:59:40 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:40 user nova-compute[71206]:     <apic/>
Jul 27 17:59:40 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:40 user nova-compute[71206]:   </features>
Jul 27 17:59:40 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:40 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:40 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:40 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:40 user nova-compute[71206]:   </clock>
Jul 27 17:59:40 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:40 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:40 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:40 user nova-compute[71206]:   </cpu>
Jul 27 17:59:40 user nova-compute[71206]:   <devices>
Jul 27 17:59:40 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:40 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:40 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk"/>
Jul 27 17:59:40 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:40 user nova-compute[71206]:     </disk>
Jul 27 17:59:40 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:40 user nova-compute[71206]:       <mac address="fa:16:3e:c2:18:31"/>
Jul 27 17:59:40 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:40 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:40 user nova-compute[71206]:       <target dev="tap8b34c85b-52"/>
Jul 27 17:59:40 user nova-compute[71206]:     </interface>
Jul 27 17:59:40 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:40 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/console.log" append="off"/>
Jul 27 17:59:40 user nova-compute[71206]:     </serial>
Jul 27 17:59:40 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:40 user nova-compute[71206]:     <video>
Jul 27 17:59:40 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:40 user nova-compute[71206]:     </video>
Jul 27 17:59:40 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:40 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:40 user nova-compute[71206]:     </rng>
Jul 27 17:59:40 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:40 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:40 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:40 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:40 user nova-compute[71206]:   </devices>
Jul 27 17:59:40 user nova-compute[71206]: </domain>
Jul 27 17:59:40 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1998307430',display_name='tempest-ServersNegativeTestJSON-server-1998307430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1998307430',id=1,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-8woyzh0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:32Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=db540ca5-3de8-47c3-968d-402bf58f5d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG os_vif [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Created schema index Interface.name {{(pid=71206) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Created schema index Port.name {{(pid=71206) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Created schema index Bridge.name {{(pid=71206) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [POLLOUT] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:40 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph5y39hjs/privsep.sock']
Jul 27 17:59:40 user sudo[80575]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph5y39hjs/privsep.sock
Jul 27 17:59:40 user sudo[80575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Successfully updated port: 41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.neutron [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updated VIF entry in instance network info cache for port 8b34c85b-523a-4a6e-acb0-a4863920df9b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.neutron [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updating instance_info_cache with network_info: [{"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-changed-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Refreshing instance network info cache due to event network-changed-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e920169e-58e6-464a-ab5a-4f02dd971763 req-5ae7b280-f352-4321-9551-29642db55622 service nova] Releasing lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Successfully created port: 4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance network_info: |[{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.neutron [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Refreshing network info cache for port 41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start _get_guest_xml network_info=[{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2065113690',display_name='tempest-ServerRescueNegativeTestJSON-server-2065113690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2065113690',id=5,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-iux9t49p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:35Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=7824a157-7697-4e8a-a212-201cf29cb062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:41 user nova-compute[71206]:   <uuid>7824a157-7697-4e8a-a212-201cf29cb062</uuid>
Jul 27 17:59:41 user nova-compute[71206]:   <name>instance-00000005</name>
Jul 27 17:59:41 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:41 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:41 user nova-compute[71206]:   <metadata>
Jul 27 17:59:41 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:41 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2065113690</nova:name>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:41</nova:creationTime>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:41 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:41 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 17:59:41 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:41 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:41 user nova-compute[71206]:         <nova:port uuid="41a69dfd-81be-4ffd-8d26-8ec2103c9ec9">
Jul 27 17:59:41 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:59:41 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:41 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:41 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:41 user nova-compute[71206]:   </metadata>
Jul 27 17:59:41 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:41 user nova-compute[71206]:     <system>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="serial">7824a157-7697-4e8a-a212-201cf29cb062</entry>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="uuid">7824a157-7697-4e8a-a212-201cf29cb062</entry>
Jul 27 17:59:41 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:41 user nova-compute[71206]:     </system>
Jul 27 17:59:41 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:41 user nova-compute[71206]:   <os>
Jul 27 17:59:41 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:41 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:41 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:41 user nova-compute[71206]:   </os>
Jul 27 17:59:41 user nova-compute[71206]:   <features>
Jul 27 17:59:41 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:41 user nova-compute[71206]:     <apic/>
Jul 27 17:59:41 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:41 user nova-compute[71206]:   </features>
Jul 27 17:59:41 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:41 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:41 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:41 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:41 user nova-compute[71206]:   </clock>
Jul 27 17:59:41 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:41 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:41 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:41 user nova-compute[71206]:   </cpu>
Jul 27 17:59:41 user nova-compute[71206]:   <devices>
Jul 27 17:59:41 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:41 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:41 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk"/>
Jul 27 17:59:41 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:41 user nova-compute[71206]:     </disk>
Jul 27 17:59:41 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:41 user nova-compute[71206]:       <mac address="fa:16:3e:26:ed:17"/>
Jul 27 17:59:41 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:41 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:41 user nova-compute[71206]:       <target dev="tap41a69dfd-81"/>
Jul 27 17:59:41 user nova-compute[71206]:     </interface>
Jul 27 17:59:41 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:41 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/console.log" append="off"/>
Jul 27 17:59:41 user nova-compute[71206]:     </serial>
Jul 27 17:59:41 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:41 user nova-compute[71206]:     <video>
Jul 27 17:59:41 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:41 user nova-compute[71206]:     </video>
Jul 27 17:59:41 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:41 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:41 user nova-compute[71206]:     </rng>
Jul 27 17:59:41 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:41 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:41 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:41 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:41 user nova-compute[71206]:   </devices>
Jul 27 17:59:41 user nova-compute[71206]: </domain>
Jul 27 17:59:41 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2065113690',display_name='tempest-ServerRescueNegativeTestJSON-server-2065113690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2065113690',id=5,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-iux9t49p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:35Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=7824a157-7697-4e8a-a212-201cf29cb062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG os_vif [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:41 user sudo[80575]: pam_unix(sudo:session): session closed for user root
Jul 27 17:59:41 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Spawned new privsep daemon via rootwrap
Jul 27 17:59:41 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 17:59:41 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 17:59:41 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 27 17:59:41 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80578
Jul 27 17:59:41 user nova-compute[71206]: WARNING oslo_privsep.priv_context [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] privsep daemon already running
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Successfully created port: a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Successfully updated port: e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-changed-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Refreshing instance network info cache due to event network-changed-e4c67d3e-88fe-445f-83c8-b25fced5471d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] Acquiring lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41a69dfd-81, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41a69dfd-81, col_values=(('external_ids', {'iface-id': '41a69dfd-81be-4ffd-8d26-8ec2103c9ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ed:17', 'vm-uuid': '7824a157-7697-4e8a-a212-201cf29cb062'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: INFO os_vif [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81')
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b34c85b-52, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b34c85b-52, col_values=(('external_ids', {'iface-id': '8b34c85b-523a-4a6e-acb0-a4863920df9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:18:31', 'vm-uuid': 'db540ca5-3de8-47c3-968d-402bf58f5d6f'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:42 user nova-compute[71206]: INFO os_vif [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52')
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] No VIF found with MAC fa:16:3e:c2:18:31, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:26:ed:17, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updated VIF entry in instance network info cache for port 41a69dfd-81be-4ffd-8d26-8ec2103c9ec9. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG nova.network.neutron [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f155fdba-f03b-4547-b541-7c90e3d8a8ff req-981b8507-9cfd-476c-abdc-fecb00f37658 service nova] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Successfully created port: 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Successfully updated port: 4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:43 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-changed-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Refreshing instance network info cache due to event network-changed-4167e460-cbf2-4ff6-b173-a5318f5e3b6c. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] Acquiring lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Instance network_info: |[{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] Acquired lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.neutron [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Refreshing network info cache for port e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Start _get_guest_xml network_info=[{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance network_info: |[{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] Acquired lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.neutron [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Refreshing network info cache for port 4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start _get_guest_xml network_info=[{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931170830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931170830',id=2,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-2ft8kh0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:33Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1086757011',display_name='tempest-ServerRescueNegativeTestJSON-server-1086757011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1086757011',id=8,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-g2cpq40t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:38Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=f4daa5a7-ada3-4d66-a84b-ac02d78220a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:44 user nova-compute[71206]:   <uuid>e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f</uuid>
Jul 27 17:59:44 user nova-compute[71206]:   <name>instance-00000002</name>
Jul 27 17:59:44 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:44 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:44 user nova-compute[71206]:   <metadata>
Jul 27 17:59:44 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:44 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-931170830</nova:name>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:44</nova:creationTime>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:44 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:port uuid="e4c67d3e-88fe-445f-83c8-b25fced5471d">
Jul 27 17:59:44 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 17:59:44 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:44 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:44 user nova-compute[71206]:   </metadata>
Jul 27 17:59:44 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:44 user nova-compute[71206]:     <system>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="serial">e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="uuid">e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:44 user nova-compute[71206]:     </system>
Jul 27 17:59:44 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:44 user nova-compute[71206]:   <os>
Jul 27 17:59:44 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:44 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:44 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:44 user nova-compute[71206]:   </os>
Jul 27 17:59:44 user nova-compute[71206]:   <features>
Jul 27 17:59:44 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:44 user nova-compute[71206]:     <apic/>
Jul 27 17:59:44 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:44 user nova-compute[71206]:   </features>
Jul 27 17:59:44 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:44 user nova-compute[71206]:   </clock>
Jul 27 17:59:44 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:44 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:44 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:44 user nova-compute[71206]:   </cpu>
Jul 27 17:59:44 user nova-compute[71206]:   <devices>
Jul 27 17:59:44 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:44 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:44 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk"/>
Jul 27 17:59:44 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:     </disk>
Jul 27 17:59:44 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:44 user nova-compute[71206]:       <mac address="fa:16:3e:c1:20:57"/>
Jul 27 17:59:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:44 user nova-compute[71206]:       <target dev="tape4c67d3e-88"/>
Jul 27 17:59:44 user nova-compute[71206]:     </interface>
Jul 27 17:59:44 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:44 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/console.log" append="off"/>
Jul 27 17:59:44 user nova-compute[71206]:     </serial>
Jul 27 17:59:44 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:44 user nova-compute[71206]:     <video>
Jul 27 17:59:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:     </video>
Jul 27 17:59:44 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:44 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:44 user nova-compute[71206]:     </rng>
Jul 27 17:59:44 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:44 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:44 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:44 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:44 user nova-compute[71206]:   </devices>
Jul 27 17:59:44 user nova-compute[71206]: </domain>
Jul 27 17:59:44 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931170830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931170830',id=2,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-2ft8kh0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:33Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG os_vif [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4c67d3e-88, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4c67d3e-88, col_values=(('external_ids', {'iface-id': 'e4c67d3e-88fe-445f-83c8-b25fced5471d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:20:57', 'vm-uuid': 'e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:44 user nova-compute[71206]:   <uuid>f4daa5a7-ada3-4d66-a84b-ac02d78220a9</uuid>
Jul 27 17:59:44 user nova-compute[71206]:   <name>instance-00000008</name>
Jul 27 17:59:44 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:44 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:44 user nova-compute[71206]:   <metadata>
Jul 27 17:59:44 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:44 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1086757011</nova:name>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:44</nova:creationTime>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:44 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:44 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:44 user nova-compute[71206]:         <nova:port uuid="4167e460-cbf2-4ff6-b173-a5318f5e3b6c">
Jul 27 17:59:44 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 17:59:44 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:44 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:44 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:44 user nova-compute[71206]:   </metadata>
Jul 27 17:59:44 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:44 user nova-compute[71206]:     <system>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="serial">f4daa5a7-ada3-4d66-a84b-ac02d78220a9</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="uuid">f4daa5a7-ada3-4d66-a84b-ac02d78220a9</entry>
Jul 27 17:59:44 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:44 user nova-compute[71206]:     </system>
Jul 27 17:59:44 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:44 user nova-compute[71206]:   <os>
Jul 27 17:59:44 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:44 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:44 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:44 user nova-compute[71206]:   </os>
Jul 27 17:59:44 user nova-compute[71206]:   <features>
Jul 27 17:59:44 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:44 user nova-compute[71206]:     <apic/>
Jul 27 17:59:44 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:44 user nova-compute[71206]:   </features>
Jul 27 17:59:44 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:44 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:44 user nova-compute[71206]:   </clock>
Jul 27 17:59:44 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:44 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:44 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:44 user nova-compute[71206]:   </cpu>
Jul 27 17:59:44 user nova-compute[71206]:   <devices>
Jul 27 17:59:44 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:44 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:44 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk"/>
Jul 27 17:59:44 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:     </disk>
Jul 27 17:59:44 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:44 user nova-compute[71206]:       <mac address="fa:16:3e:fc:53:81"/>
Jul 27 17:59:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:44 user nova-compute[71206]:       <target dev="tap4167e460-cb"/>
Jul 27 17:59:44 user nova-compute[71206]:     </interface>
Jul 27 17:59:44 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:44 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/console.log" append="off"/>
Jul 27 17:59:44 user nova-compute[71206]:     </serial>
Jul 27 17:59:44 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:44 user nova-compute[71206]:     <video>
Jul 27 17:59:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:44 user nova-compute[71206]:     </video>
Jul 27 17:59:44 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:44 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:44 user nova-compute[71206]:     </rng>
Jul 27 17:59:44 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:44 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:44 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:44 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:44 user nova-compute[71206]:   </devices>
Jul 27 17:59:44 user nova-compute[71206]: </domain>
Jul 27 17:59:44 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1086757011',display_name='tempest-ServerRescueNegativeTestJSON-server-1086757011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1086757011',id=8,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-g2cpq40t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:38Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=f4daa5a7-ada3-4d66-a84b-ac02d78220a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG os_vif [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: INFO os_vif [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88')
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4167e460-cb, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4167e460-cb, col_values=(('external_ids', {'iface-id': '4167e460-cbf2-4ff6-b173-a5318f5e3b6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:53:81', 'vm-uuid': 'f4daa5a7-ada3-4d66-a84b-ac02d78220a9'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: INFO os_vif [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb')
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:c1:20:57, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:fc:53:81, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Successfully updated port: cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-changed-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Refreshing instance network info cache due to event network-changed-cc85a1c7-e1be-4e96-9640-8be9a65a8174. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Successfully updated port: 9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquired lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updated VIF entry in instance network info cache for port e4c67d3e-88fe-445f-83c8-b25fced5471d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8a1adbe-39c9-411d-8d2e-9f4a4b02c3be req-f594c928-2968-4dea-b2fe-a4378957185e service nova] Releasing lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updated VIF entry in instance network info cache for port 4167e460-cbf2-4ff6-b173-a5318f5e3b6c. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-changed-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Refreshing instance network info cache due to event network-changed-9e2205c9-1194-427b-829f-8103572bff88. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Acquiring lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2cd6844a-887c-4706-aad3-e3590447dafc req-68e51c72-9dd2-4a2f-8da5-42f95a2a7f56 service nova] Releasing lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.compute.manager [req-f276982e-2891-4736-b791-c365fd8b8e0b req-72350ab3-f9dd-4f63-a3d8-1fd2489c446e service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state building and task_state spawning.
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] No waiting events found dispatching network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.compute.manager [req-f6598997-cf8d-43d7-a20c-aa816ef1fe1b req-94f6d11d-13d7-4c01-8641-76e8941875af service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received unexpected event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d for instance with vm_state building and task_state spawning.
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Successfully updated port: a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance network_info: |[{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Refreshing network info cache for port cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start _get_guest_xml network_info=[{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updating instance_info_cache with network_info: [{"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.objects.instance [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'pci_devices' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Releasing lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Instance network_info: |[{"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Acquired lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Refreshing network info cache for port 9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Start _get_guest_xml network_info=[{"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:48 user nova-compute[71206]:   <uuid>86884431-10bd-401b-9351-f56a32e82047</uuid>
Jul 27 17:59:48 user nova-compute[71206]:   <name>instance-00000003</name>
Jul 27 17:59:48 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:48 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:48 user nova-compute[71206]:   <metadata>
Jul 27 17:59:48 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:48 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1045738722</nova:name>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:48</nova:creationTime>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:48 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:user uuid="a2e5a1cc2e1c45c9ae97077decdb228e">tempest-ServerActionsTestOtherB-86360800-project-member</nova:user>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:project uuid="5679fcb6cd0d4b6da2908fbf1d225eec">tempest-ServerActionsTestOtherB-86360800</nova:project>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:port uuid="cc85a1c7-e1be-4e96-9640-8be9a65a8174">
Jul 27 17:59:48 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 17:59:48 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:48 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:48 user nova-compute[71206]:   </metadata>
Jul 27 17:59:48 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:48 user nova-compute[71206]:     <system>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="serial">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="uuid">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:48 user nova-compute[71206]:     </system>
Jul 27 17:59:48 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:48 user nova-compute[71206]:   <os>
Jul 27 17:59:48 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:48 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:48 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:48 user nova-compute[71206]:   </os>
Jul 27 17:59:48 user nova-compute[71206]:   <features>
Jul 27 17:59:48 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:48 user nova-compute[71206]:     <apic/>
Jul 27 17:59:48 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:48 user nova-compute[71206]:   </features>
Jul 27 17:59:48 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:48 user nova-compute[71206]:   </clock>
Jul 27 17:59:48 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:48 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:48 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:48 user nova-compute[71206]:   </cpu>
Jul 27 17:59:48 user nova-compute[71206]:   <devices>
Jul 27 17:59:48 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:48 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:48 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk"/>
Jul 27 17:59:48 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:     </disk>
Jul 27 17:59:48 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:48 user nova-compute[71206]:       <mac address="fa:16:3e:16:b7:4b"/>
Jul 27 17:59:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:48 user nova-compute[71206]:       <target dev="tapcc85a1c7-e1"/>
Jul 27 17:59:48 user nova-compute[71206]:     </interface>
Jul 27 17:59:48 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:48 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/console.log" append="off"/>
Jul 27 17:59:48 user nova-compute[71206]:     </serial>
Jul 27 17:59:48 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:48 user nova-compute[71206]:     <video>
Jul 27 17:59:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:     </video>
Jul 27 17:59:48 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:48 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:48 user nova-compute[71206]:     </rng>
Jul 27 17:59:48 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:48 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:48 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:48 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:48 user nova-compute[71206]:   </devices>
Jul 27 17:59:48 user nova-compute[71206]: </domain>
Jul 27 17:59:48 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG os_vif [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc85a1c7-e1, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc85a1c7-e1, col_values=(('external_ids', {'iface-id': 'cc85a1c7-e1be-4e96-9640-8be9a65a8174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:4b', 'vm-uuid': '86884431-10bd-401b-9351-f56a32e82047'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-102117359',display_name='tempest-DeleteServersTestJSON-server-102117359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-102117359',id=4,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed96b96d9354c78ad378575a68b98a8',ramdisk_id='',reservation_id='r-961qnf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1742407945',owner_user_name='tempest-DeleteServersTestJSON-1742407945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:35Z,user_data=None,user_id='11517efe2d6c4446a70ebee263053835',uuid=eab112a5-6c8d-4d54-86f9-15e28491d037,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converting VIF {"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lazy-loading 'pci_devices' on Instance uuid eab112a5-6c8d-4d54-86f9-15e28491d037 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: INFO os_vif [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:48 user nova-compute[71206]:   <uuid>eab112a5-6c8d-4d54-86f9-15e28491d037</uuid>
Jul 27 17:59:48 user nova-compute[71206]:   <name>instance-00000004</name>
Jul 27 17:59:48 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:48 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:48 user nova-compute[71206]:   <metadata>
Jul 27 17:59:48 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:48 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:name>tempest-DeleteServersTestJSON-server-102117359</nova:name>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:48</nova:creationTime>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:48 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:user uuid="11517efe2d6c4446a70ebee263053835">tempest-DeleteServersTestJSON-1742407945-project-member</nova:user>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:project uuid="7ed96b96d9354c78ad378575a68b98a8">tempest-DeleteServersTestJSON-1742407945</nova:project>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:48 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:48 user nova-compute[71206]:         <nova:port uuid="9e2205c9-1194-427b-829f-8103572bff88">
Jul 27 17:59:48 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 17:59:48 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:48 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:48 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:48 user nova-compute[71206]:   </metadata>
Jul 27 17:59:48 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:48 user nova-compute[71206]:     <system>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="serial">eab112a5-6c8d-4d54-86f9-15e28491d037</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="uuid">eab112a5-6c8d-4d54-86f9-15e28491d037</entry>
Jul 27 17:59:48 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:48 user nova-compute[71206]:     </system>
Jul 27 17:59:48 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:48 user nova-compute[71206]:   <os>
Jul 27 17:59:48 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:48 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:48 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:48 user nova-compute[71206]:   </os>
Jul 27 17:59:48 user nova-compute[71206]:   <features>
Jul 27 17:59:48 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:48 user nova-compute[71206]:     <apic/>
Jul 27 17:59:48 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:48 user nova-compute[71206]:   </features>
Jul 27 17:59:48 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:48 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:48 user nova-compute[71206]:   </clock>
Jul 27 17:59:48 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:48 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:48 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:48 user nova-compute[71206]:   </cpu>
Jul 27 17:59:48 user nova-compute[71206]:   <devices>
Jul 27 17:59:48 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:48 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:48 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk"/>
Jul 27 17:59:48 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:     </disk>
Jul 27 17:59:48 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:48 user nova-compute[71206]:       <mac address="fa:16:3e:c8:e1:6d"/>
Jul 27 17:59:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:48 user nova-compute[71206]:       <target dev="tap9e2205c9-11"/>
Jul 27 17:59:48 user nova-compute[71206]:     </interface>
Jul 27 17:59:48 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:48 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/console.log" append="off"/>
Jul 27 17:59:48 user nova-compute[71206]:     </serial>
Jul 27 17:59:48 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:48 user nova-compute[71206]:     <video>
Jul 27 17:59:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:48 user nova-compute[71206]:     </video>
Jul 27 17:59:48 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:48 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:48 user nova-compute[71206]:     </rng>
Jul 27 17:59:48 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:48 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:48 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:48 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:48 user nova-compute[71206]:   </devices>
Jul 27 17:59:48 user nova-compute[71206]: </domain>
Jul 27 17:59:48 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-102117359',display_name='tempest-DeleteServersTestJSON-server-102117359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-102117359',id=4,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed96b96d9354c78ad378575a68b98a8',ramdisk_id='',reservation_id='r-961qnf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1742407945',owner_user_name='tempest-DeleteServersTestJSON-1742407945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:35Z,user_data=None,user_id='11517efe2d6c4446a70ebee263053835',uuid=eab112a5-6c8d-4d54-86f9-15e28491d037,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converting VIF {"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG os_vif [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e2205c9-11, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e2205c9-11, col_values=(('external_ids', {'iface-id': '9e2205c9-1194-427b-829f-8103572bff88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:e1:6d', 'vm-uuid': 'eab112a5-6c8d-4d54-86f9-15e28491d037'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:48 user nova-compute[71206]: INFO os_vif [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11')
Jul 27 17:59:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No VIF found with MAC fa:16:3e:16:b7:4b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480789.0519342, db540ca5-3de8-47c3-968d-402bf58f5d6f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:49 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] VM Resumed (Lifecycle Event)
Jul 27 17:59:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] No VIF found with MAC fa:16:3e:c8:e1:6d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Instance spawned successfully.
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:59:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Successfully updated port: 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing instance network info cache due to event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] No waiting events found dispatching network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:50 user nova-compute[71206]: WARNING nova.compute.manager [req-89c28911-d7fb-4aec-bb3c-f791701f03e9 req-a9d7646c-4562-4b98-8f20-aa0824ed8546 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received unexpected event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d for instance with vm_state building and task_state spawning.
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:50 user nova-compute[71206]: WARNING nova.compute.manager [req-31d89a2b-eda3-4889-8dab-f3699db68c0b req-4bc90d52-8f6c-44f0-a552-aead79485544 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state building and task_state spawning.
Jul 27 17:59:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updated VIF entry in instance network info cache for port 9e2205c9-1194-427b-829f-8103572bff88. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updating instance_info_cache with network_info: [{"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Releasing lock "refresh_cache-eab112a5-6c8d-4d54-86f9-15e28491d037" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] No waiting events found dispatching network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:51 user nova-compute[71206]: WARNING nova.compute.manager [req-da1ffdd3-2809-4128-963b-cb537e211441 req-654d992a-2288-4a86-bb17-234b572e3061 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received unexpected event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b for instance with vm_state building and task_state spawning.
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance network_info: |[{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start _get_guest_xml network_info=[{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.network.neutron [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance network_info: |[{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start _get_guest_xml network_info=[{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updated VIF entry in instance network info cache for port cc85a1c7-e1be-4e96-9640-8be9a65a8174. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b5b601d-4d5b-4536-99bf-b780f9b54e99 req-59383a58-fe41-46c5-a828-93348aadb9e2 service nova] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:52 user nova-compute[71206]: WARNING nova.compute.manager [req-5c1274f7-d025-4305-88e6-affc62ff0647 req-16dd391d-5f49-4be0-83f0-c0df8a2f66b0 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state building and task_state spawning.
Jul 27 17:59:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance spawned successfully.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpXpxN//cqXL2CbTzpUViRWm87TtCfzxyOaA9/zigvj4d6W8AOBPdsnY2L0TfwW1qpHr7QA5x4Uk3a/uAmbpFu8TjE3F7Kv397LxSZ520rqGXuIaO8SvoyAi/kAb/blzw==',key_name='tempest-keypair-1398730537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480789.0579786, db540ca5-3de8-47c3-968d-402bf58f5d6f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] VM Started (Lifecycle Event)
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2072367951',display_name='tempest-ServerStableDeviceRescueTest-server-2072367951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2072367951',id=7,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHt6bkycVjKTXxU0uQQUQLsipCybbo5tqpxXIbkmbqimQuV0ZXzMkXaJPa2UkZk+4IB6PDVpRs5r/GPVH50Ktgikwnozo0rO81mXFRR2f2q/WxryWWYYhwq5m//GEqM8A==',key_name='tempest-keypair-71631035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9d3feea7c4d069de51b33ff29ce4b',ramdisk_id='',reservation_id='r-tbob8kt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1738306522',owner_user_name='tempest-ServerStableDeviceRescueTest-1738306522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e118a0a4fcb49b185eb68e74988195f',uuid=71cb36ca-6721-4882-b30d-68ae8189e0c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converting VIF {"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'pci_devices' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:53 user nova-compute[71206]:   <uuid>d1c93904-5854-4093-a782-58723eb98bb9</uuid>
Jul 27 17:59:53 user nova-compute[71206]:   <name>instance-00000006</name>
Jul 27 17:59:53 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:53 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:53 user nova-compute[71206]:   <metadata>
Jul 27 17:59:53 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:53 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-852198924</nova:name>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:53</nova:creationTime>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:53 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:user uuid="4fa4ebea12dd4e89b0ae6097aae1bb7a">tempest-AttachVolumeShelveTestJSON-760609809-project-member</nova:user>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:project uuid="3f383884701844a8b955177235bbbd4c">tempest-AttachVolumeShelveTestJSON-760609809</nova:project>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:port uuid="a7201185-dc60-491f-852e-03df17fcb1bd">
Jul 27 17:59:53 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 17:59:53 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:53 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:53 user nova-compute[71206]:   </metadata>
Jul 27 17:59:53 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:53 user nova-compute[71206]:     <system>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="serial">d1c93904-5854-4093-a782-58723eb98bb9</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="uuid">d1c93904-5854-4093-a782-58723eb98bb9</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:53 user nova-compute[71206]:     </system>
Jul 27 17:59:53 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:53 user nova-compute[71206]:   <os>
Jul 27 17:59:53 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:53 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:53 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:53 user nova-compute[71206]:   </os>
Jul 27 17:59:53 user nova-compute[71206]:   <features>
Jul 27 17:59:53 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:53 user nova-compute[71206]:     <apic/>
Jul 27 17:59:53 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:53 user nova-compute[71206]:   </features>
Jul 27 17:59:53 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:53 user nova-compute[71206]:   </clock>
Jul 27 17:59:53 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:53 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:53 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:53 user nova-compute[71206]:   </cpu>
Jul 27 17:59:53 user nova-compute[71206]:   <devices>
Jul 27 17:59:53 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:53 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:53 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk"/>
Jul 27 17:59:53 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:     </disk>
Jul 27 17:59:53 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:53 user nova-compute[71206]:       <mac address="fa:16:3e:ce:66:13"/>
Jul 27 17:59:53 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:53 user nova-compute[71206]:       <target dev="tapa7201185-dc"/>
Jul 27 17:59:53 user nova-compute[71206]:     </interface>
Jul 27 17:59:53 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:53 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/console.log" append="off"/>
Jul 27 17:59:53 user nova-compute[71206]:     </serial>
Jul 27 17:59:53 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:53 user nova-compute[71206]:     <video>
Jul 27 17:59:53 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:     </video>
Jul 27 17:59:53 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:53 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:53 user nova-compute[71206]:     </rng>
Jul 27 17:59:53 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:53 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:53 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:53 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:53 user nova-compute[71206]:   </devices>
Jul 27 17:59:53 user nova-compute[71206]: </domain>
Jul 27 17:59:53 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpXpxN//cqXL2CbTzpUViRWm87TtCfzxyOaA9/zigvj4d6W8AOBPdsnY2L0TfwW1qpHr7QA5x4Uk3a/uAmbpFu8TjE3F7Kv397LxSZ520rqGXuIaO8SvoyAi/kAb/blzw==',key_name='tempest-keypair-1398730537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG os_vif [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Took 21.62 seconds to spawn the instance on the hypervisor.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:59:53 user nova-compute[71206]:   <uuid>71cb36ca-6721-4882-b30d-68ae8189e0c6</uuid>
Jul 27 17:59:53 user nova-compute[71206]:   <name>instance-00000007</name>
Jul 27 17:59:53 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 17:59:53 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 17:59:53 user nova-compute[71206]:   <metadata>
Jul 27 17:59:53 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:59:53 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2072367951</nova:name>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:creationTime>2023-07-27 17:59:53</nova:creationTime>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 17:59:53 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:flavor>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:owner>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:user uuid="2e118a0a4fcb49b185eb68e74988195f">tempest-ServerStableDeviceRescueTest-1738306522-project-member</nova:user>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:project uuid="5df9d3feea7c4d069de51b33ff29ce4b">tempest-ServerStableDeviceRescueTest-1738306522</nova:project>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:owner>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 17:59:53 user nova-compute[71206]:       <nova:ports>
Jul 27 17:59:53 user nova-compute[71206]:         <nova:port uuid="061c4266-2991-4ee7-96f8-ee73173df5fa">
Jul 27 17:59:53 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 17:59:53 user nova-compute[71206]:         </nova:port>
Jul 27 17:59:53 user nova-compute[71206]:       </nova:ports>
Jul 27 17:59:53 user nova-compute[71206]:     </nova:instance>
Jul 27 17:59:53 user nova-compute[71206]:   </metadata>
Jul 27 17:59:53 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 17:59:53 user nova-compute[71206]:     <system>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="serial">71cb36ca-6721-4882-b30d-68ae8189e0c6</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="uuid">71cb36ca-6721-4882-b30d-68ae8189e0c6</entry>
Jul 27 17:59:53 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:59:53 user nova-compute[71206]:     </system>
Jul 27 17:59:53 user nova-compute[71206]:   </sysinfo>
Jul 27 17:59:53 user nova-compute[71206]:   <os>
Jul 27 17:59:53 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:59:53 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 17:59:53 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 17:59:53 user nova-compute[71206]:   </os>
Jul 27 17:59:53 user nova-compute[71206]:   <features>
Jul 27 17:59:53 user nova-compute[71206]:     <acpi/>
Jul 27 17:59:53 user nova-compute[71206]:     <apic/>
Jul 27 17:59:53 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 17:59:53 user nova-compute[71206]:   </features>
Jul 27 17:59:53 user nova-compute[71206]:   <clock offset="utc">
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:59:53 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 17:59:53 user nova-compute[71206]:   </clock>
Jul 27 17:59:53 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 17:59:53 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 17:59:53 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:59:53 user nova-compute[71206]:   </cpu>
Jul 27 17:59:53 user nova-compute[71206]:   <devices>
Jul 27 17:59:53 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 17:59:53 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:59:53 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk"/>
Jul 27 17:59:53 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:     </disk>
Jul 27 17:59:53 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 17:59:53 user nova-compute[71206]:       <mac address="fa:16:3e:ae:41:5b"/>
Jul 27 17:59:53 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 17:59:53 user nova-compute[71206]:       <target dev="tap061c4266-29"/>
Jul 27 17:59:53 user nova-compute[71206]:     </interface>
Jul 27 17:59:53 user nova-compute[71206]:     <serial type="pty">
Jul 27 17:59:53 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/console.log" append="off"/>
Jul 27 17:59:53 user nova-compute[71206]:     </serial>
Jul 27 17:59:53 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:59:53 user nova-compute[71206]:     <video>
Jul 27 17:59:53 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 17:59:53 user nova-compute[71206]:     </video>
Jul 27 17:59:53 user nova-compute[71206]:     <rng model="virtio">
Jul 27 17:59:53 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:59:53 user nova-compute[71206]:     </rng>
Jul 27 17:59:53 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:59:53 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 17:59:53 user nova-compute[71206]:       <stats period="10"/>
Jul 27 17:59:53 user nova-compute[71206]:     </memballoon>
Jul 27 17:59:53 user nova-compute[71206]:   </devices>
Jul 27 17:59:53 user nova-compute[71206]: </domain>
Jul 27 17:59:53 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2072367951',display_name='tempest-ServerStableDeviceRescueTest-server-2072367951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2072367951',id=7,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHt6bkycVjKTXxU0uQQUQLsipCybbo5tqpxXIbkmbqimQuV0ZXzMkXaJPa2UkZk+4IB6PDVpRs5r/GPVH50Ktgikwnozo0rO81mXFRR2f2q/WxryWWYYhwq5m//GEqM8A==',key_name='tempest-keypair-71631035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5df9d3feea7c4d069de51b33ff29ce4b',ramdisk_id='',reservation_id='r-tbob8kt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1738306522',owner_user_name='tempest-ServerStableDeviceRescueTest-1738306522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e118a0a4fcb49b185eb68e74988195f',uuid=71cb36ca-6721-4882-b30d-68ae8189e0c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converting VIF {"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG os_vif [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] No waiting events found dispatching network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.compute.manager [req-061164f1-70da-4ec5-9975-19989240dc72 req-612656d7-e0a9-4923-bef3-929589766edd service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received unexpected event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 for instance with vm_state building and task_state spawning.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7201185-dc, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7201185-dc, col_values=(('external_ids', {'iface-id': 'a7201185-dc60-491f-852e-03df17fcb1bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:66:13', 'vm-uuid': 'd1c93904-5854-4093-a782-58723eb98bb9'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: INFO os_vif [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc')
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap061c4266-29, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap061c4266-29, col_values=(('external_ids', {'iface-id': '061c4266-2991-4ee7-96f8-ee73173df5fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:41:5b', 'vm-uuid': '71cb36ca-6721-4882-b30d-68ae8189e0c6'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updated VIF entry in instance network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480793.3988702, 7824a157-7697-4e8a-a212-201cf29cb062 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Resumed (Lifecycle Event)
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:53 user nova-compute[71206]: INFO os_vif [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29')
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] No waiting events found dispatching network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:53 user nova-compute[71206]: WARNING nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received unexpected event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b for instance with vm_state building and task_state spawning.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing instance network info cache due to event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Took 18.32 seconds to spawn the instance on the hypervisor.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Took 22.74 seconds to build instance.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No VIF found with MAC fa:16:3e:ce:66:13, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480793.4006407, 7824a157-7697-4e8a-a212-201cf29cb062 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Started (Lifecycle Event)
Jul 27 17:59:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5dd711f2-1417-4559-8eca-4278d1b38127 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.019s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:54 user nova-compute[71206]: INFO nova.compute.manager [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Took 20.27 seconds to build instance.
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8c78b3b2-1d80-4947-87e6-e5dbc951ca8c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.516s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No VIF found with MAC fa:16:3e:ae:41:5b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:54 user nova-compute[71206]: WARNING nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state building and task_state spawning.
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:54 user nova-compute[71206]: WARNING nova.compute.manager [req-39a1ecdc-c65c-44c7-b968-4783d0ee2c55 req-743b0ebe-f36c-4bac-980c-4ddd5fdf5a45 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state building and task_state spawning.
Jul 27 17:59:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updated VIF entry in instance network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2bf39192-a378-4685-821f-f5994ded0bf7 req-b2c7a97f-bebc-4fed-8e0e-241b4199a888 service nova] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] No waiting events found dispatching network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:55 user nova-compute[71206]: WARNING nova.compute.manager [req-dd857a24-5ae6-4393-b668-9652e58a8435 req-46edf540-d9fc-4096-9ada-ab60a1619dea service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received unexpected event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 for instance with vm_state building and task_state spawning.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Instance spawned successfully.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance spawned successfully.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480794.714707, e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] VM Resumed (Lifecycle Event)
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480794.7161312, e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] VM Started (Lifecycle Event)
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Took 23.29 seconds to spawn the instance on the hypervisor.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Took 18.30 seconds to spawn the instance on the hypervisor.
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:56 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480796.3522117, f4daa5a7-ada3-4d66-a84b-ac02d78220a9 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] VM Resumed (Lifecycle Event)
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:57 user nova-compute[71206]: WARNING nova.compute.manager [req-e4110028-782d-4554-aa9c-ef60ee84a922 req-8e0c2051-ec78-4533-92da-db85b4774758 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state building and task_state spawning.
Jul 27 17:59:57 user nova-compute[71206]: INFO nova.compute.manager [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Took 25.02 seconds to build instance.
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:57 user nova-compute[71206]: INFO nova.compute.manager [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Took 20.62 seconds to build instance.
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fad722eb-c11d-471b-9b4c-19458fa8c96c tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.790s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a71e047-0f27-4e06-9557-997170f34699 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.262s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480796.3526502, f4daa5a7-ada3-4d66-a84b-ac02d78220a9 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:57 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] VM Started (Lifecycle Event)
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:59:58 user nova-compute[71206]: WARNING nova.compute.manager [req-de64b0a7-d256-4e81-930d-f69475530eed req-3b9ba877-72e3-4a2a-83af-82731c5dc7cd service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state building and task_state spawning.
Jul 27 17:59:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480798.741882, eab112a5-6c8d-4d54-86f9-15e28491d037 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:58 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] VM Resumed (Lifecycle Event)
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Instance spawned successfully.
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:58 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480798.753553, eab112a5-6c8d-4d54-86f9-15e28491d037 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:59:58 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] VM Started (Lifecycle Event)
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:59:59 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:59:59 user nova-compute[71206]: INFO nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Took 24.40 seconds to spawn the instance on the hypervisor.
Jul 27 17:59:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:59 user nova-compute[71206]: INFO nova.compute.manager [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Took 25.58 seconds to build instance.
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f744e314-ec67-4d89-acb2-3be8e780b2b4 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.893s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:59:59 user nova-compute[71206]: INFO nova.compute.claims [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Claim successful on node user
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:59:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480800.005576, 86884431-10bd-401b-9351-f56a32e82047 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Resumed (Lifecycle Event)
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance spawned successfully.
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480800.0181642, 86884431-10bd-401b-9351-f56a32e82047 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Started (Lifecycle Event)
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:00 user nova-compute[71206]: WARNING nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state building and task_state spawning.
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:00 user nova-compute[71206]: WARNING nova.compute.manager [req-3a086039-847a-4584-b633-7e323acfa900 req-843324d8-8844-4258-85c3-ca7277add3d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state building and task_state spawning.
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Took 26.17 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:00 user nova-compute[71206]: INFO nova.compute.manager [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Took 27.13 seconds to build instance.
Jul 27 18:00:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-310cf165-a855-4b24-b3ae-bb370b0db4e1 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.256s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.386s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.886s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.compute.claims [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Claim successful on node user
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.policy [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '411afe8aa87048debd9703a1b141eb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679da984d9634ff18a2af5f57475a990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480801.5677335, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Resumed (Lifecycle Event)
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance spawned successfully.
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Creating image(s)
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480801.56938, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Started (Lifecycle Event)
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.260s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Took 24.62 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance spawned successfully.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.210s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480801.7076635, d1c93904-5854-4093-a782-58723eb98bb9 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Resumed (Lifecycle Event)
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk 1073741824" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Took 25.72 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Took 26.27 seconds to build instance.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a43f4d0-7c9a-4f4e-8298-31a945a15f83 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.505s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:02 user nova-compute[71206]: WARNING nova.compute.manager [req-dde1bc97-4025-4904-845e-b10d4cf54ceb req-bff399dd-3768-444a-a0df-ad20cdd57776 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state building and task_state spawning.
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480801.715831, d1c93904-5854-4093-a782-58723eb98bb9 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Started (Lifecycle Event)
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.381s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.618s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:00:02 user nova-compute[71206]: INFO nova.compute.manager [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Took 27.43 seconds to build instance.
Jul 27 18:00:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4baaffae-19b5-4c3a-b08f-cdf57d51a42d tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.636s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:00:02 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:00:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Cannot resize image /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'migration_context' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Ensure instance console log exists: /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.policy [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '204444b73ce844fd9514fcc031569ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4baf2bde924071b61112ce65124c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:00:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Creating image(s)
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "/opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "/opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "/opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.375s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.220s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk 1073741824" returned: 0 in 0.126s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Cannot resize image /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG nova.objects.instance [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'migration_context' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Ensure instance console log exists: /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Successfully created port: 2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:00:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Successfully created port: f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:00:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:00:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:06 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:00:06 user nova-compute[71206]: INFO nova.compute.claims [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Claim successful on node user
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.024s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:00:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:00:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Creating image(s)
Jul 27 18:00:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "/opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "/opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "/opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.358s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG nova.policy [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '825130825ff442898bc4783be5a45a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd5677e4fd84943a4ddd1ae7c1e737a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.328s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk 1073741824" returned: 0 in 0.063s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.239s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:00:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Cannot resize image /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'migration_context' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Ensure instance console log exists: /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Successfully updated port: 2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-changed-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing instance network info cache due to event network-changed-2846403b-4b4b-45d6-913f-aca6ec36385e. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:00:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Successfully updated port: f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:00:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquired lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:00:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Instance network_info: |[{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.neutron [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing network info cache for port 2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Start _get_guest_xml network_info=[{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:00:11 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:11 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.objects.instance [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'pci_devices' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:00:11 user nova-compute[71206]:   <uuid>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</uuid>
Jul 27 18:00:11 user nova-compute[71206]:   <name>instance-00000009</name>
Jul 27 18:00:11 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:00:11 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:00:11 user nova-compute[71206]:   <metadata>
Jul 27 18:00:11 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:00:11 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:00:11</nova:creationTime>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:00:11 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:00:11 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:owner>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:00:11 user nova-compute[71206]:       </nova:owner>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:00:11 user nova-compute[71206]:       <nova:ports>
Jul 27 18:00:11 user nova-compute[71206]:         <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:00:11 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:00:11 user nova-compute[71206]:         </nova:port>
Jul 27 18:00:11 user nova-compute[71206]:       </nova:ports>
Jul 27 18:00:11 user nova-compute[71206]:     </nova:instance>
Jul 27 18:00:11 user nova-compute[71206]:   </metadata>
Jul 27 18:00:11 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:00:11 user nova-compute[71206]:     <system>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="serial">94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="uuid">94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:00:11 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:00:11 user nova-compute[71206]:     </system>
Jul 27 18:00:11 user nova-compute[71206]:   </sysinfo>
Jul 27 18:00:11 user nova-compute[71206]:   <os>
Jul 27 18:00:11 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:00:11 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:00:11 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:00:11 user nova-compute[71206]:   </os>
Jul 27 18:00:11 user nova-compute[71206]:   <features>
Jul 27 18:00:11 user nova-compute[71206]:     <acpi/>
Jul 27 18:00:11 user nova-compute[71206]:     <apic/>
Jul 27 18:00:11 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:00:11 user nova-compute[71206]:   </features>
Jul 27 18:00:11 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:00:11 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:00:11 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:00:11 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:00:11 user nova-compute[71206]:   </clock>
Jul 27 18:00:11 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:00:11 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:00:11 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:00:11 user nova-compute[71206]:   </cpu>
Jul 27 18:00:11 user nova-compute[71206]:   <devices>
Jul 27 18:00:11 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:00:11 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:00:11 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk"/>
Jul 27 18:00:11 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:00:11 user nova-compute[71206]:     </disk>
Jul 27 18:00:11 user nova-compute[71206]:     <disk type="file" device="cdrom">
Jul 27 18:00:11 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 18:00:11 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config"/>
Jul 27 18:00:11 user nova-compute[71206]:       <target dev="hda" bus="ide"/>
Jul 27 18:00:11 user nova-compute[71206]:     </disk>
Jul 27 18:00:11 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:00:11 user nova-compute[71206]:       <mac address="fa:16:3e:57:be:a8"/>
Jul 27 18:00:11 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:11 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:00:11 user nova-compute[71206]:       <target dev="tap2846403b-4b"/>
Jul 27 18:00:11 user nova-compute[71206]:     </interface>
Jul 27 18:00:11 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:00:11 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log" append="off"/>
Jul 27 18:00:11 user nova-compute[71206]:     </serial>
Jul 27 18:00:11 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:00:11 user nova-compute[71206]:     <video>
Jul 27 18:00:11 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:11 user nova-compute[71206]:     </video>
Jul 27 18:00:11 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:00:11 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:00:11 user nova-compute[71206]:     </rng>
Jul 27 18:00:11 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:00:11 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:00:11 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:00:11 user nova-compute[71206]:     </memballoon>
Jul 27 18:00:11 user nova-compute[71206]:   </devices>
Jul 27 18:00:11 user nova-compute[71206]: </domain>
Jul 27 18:00:11 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG os_vif [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2846403b-4b, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2846403b-4b, col_values=(('external_ids', {'iface-id': '2846403b-4b4b-45d6-913f-aca6ec36385e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:be:a8', 'vm-uuid': '94791cd9-cfbb-4d07-82f0-3cbfaaacbf13'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:11 user nova-compute[71206]: INFO os_vif [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b')
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No VIF found with MAC fa:16:3e:57:be:a8, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:00:11 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Using config drive
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-changed-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Refreshing instance network info cache due to event network-changed-f3a08c29-ae46-4a09-936a-142747a0b0e7. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:00:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] Acquiring lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updating instance_info_cache with network_info: [{"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Releasing lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Instance network_info: |[{"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] Acquired lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Refreshing network info cache for port f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Start _get_guest_xml network_info=[{"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Successfully created port: 107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:00:12 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:12 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-6788576',display_name='tempest-VolumesAdminNegativeTest-server-6788576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-6788576',id=10,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfaOx8StgDGvN7b6iACZBDEuWkxCeDl89+w0LfAzbFMyCxrEonIet76dx3MfwX4Xfb3JAKG8e50e9f6bbpThUkQmK8I9p2HXy/1ipDBxWI/WIyPNlce3EHwzZ27PdyfKA==',key_name='tempest-keypair-800891234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-jg6jejd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204444b73ce844fd9514fcc031569ae4',uuid=80b19738-1683-4af2-a706-4ec8d9fd24e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.objects.instance [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'pci_devices' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:00:12 user nova-compute[71206]:   <uuid>80b19738-1683-4af2-a706-4ec8d9fd24e5</uuid>
Jul 27 18:00:12 user nova-compute[71206]:   <name>instance-0000000a</name>
Jul 27 18:00:12 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:00:12 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:00:12 user nova-compute[71206]:   <metadata>
Jul 27 18:00:12 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:00:12 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:name>tempest-VolumesAdminNegativeTest-server-6788576</nova:name>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:00:12</nova:creationTime>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:00:12 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:00:12 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:owner>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:user uuid="204444b73ce844fd9514fcc031569ae4">tempest-VolumesAdminNegativeTest-426544505-project-member</nova:user>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:project uuid="0a4baf2bde924071b61112ce65124c1e">tempest-VolumesAdminNegativeTest-426544505</nova:project>
Jul 27 18:00:12 user nova-compute[71206]:       </nova:owner>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:00:12 user nova-compute[71206]:       <nova:ports>
Jul 27 18:00:12 user nova-compute[71206]:         <nova:port uuid="f3a08c29-ae46-4a09-936a-142747a0b0e7">
Jul 27 18:00:12 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 18:00:12 user nova-compute[71206]:         </nova:port>
Jul 27 18:00:12 user nova-compute[71206]:       </nova:ports>
Jul 27 18:00:12 user nova-compute[71206]:     </nova:instance>
Jul 27 18:00:12 user nova-compute[71206]:   </metadata>
Jul 27 18:00:12 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:00:12 user nova-compute[71206]:     <system>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="serial">80b19738-1683-4af2-a706-4ec8d9fd24e5</entry>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="uuid">80b19738-1683-4af2-a706-4ec8d9fd24e5</entry>
Jul 27 18:00:12 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:00:12 user nova-compute[71206]:     </system>
Jul 27 18:00:12 user nova-compute[71206]:   </sysinfo>
Jul 27 18:00:12 user nova-compute[71206]:   <os>
Jul 27 18:00:12 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:00:12 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:00:12 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:00:12 user nova-compute[71206]:   </os>
Jul 27 18:00:12 user nova-compute[71206]:   <features>
Jul 27 18:00:12 user nova-compute[71206]:     <acpi/>
Jul 27 18:00:12 user nova-compute[71206]:     <apic/>
Jul 27 18:00:12 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:00:12 user nova-compute[71206]:   </features>
Jul 27 18:00:12 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:00:12 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:00:12 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:00:12 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:00:12 user nova-compute[71206]:   </clock>
Jul 27 18:00:12 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:00:12 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:00:12 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:00:12 user nova-compute[71206]:   </cpu>
Jul 27 18:00:12 user nova-compute[71206]:   <devices>
Jul 27 18:00:12 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:00:12 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:00:12 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk"/>
Jul 27 18:00:12 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:00:12 user nova-compute[71206]:     </disk>
Jul 27 18:00:12 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:00:12 user nova-compute[71206]:       <mac address="fa:16:3e:ab:2b:53"/>
Jul 27 18:00:12 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:12 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:00:12 user nova-compute[71206]:       <target dev="tapf3a08c29-ae"/>
Jul 27 18:00:12 user nova-compute[71206]:     </interface>
Jul 27 18:00:12 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:00:12 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/console.log" append="off"/>
Jul 27 18:00:12 user nova-compute[71206]:     </serial>
Jul 27 18:00:12 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:00:12 user nova-compute[71206]:     <video>
Jul 27 18:00:12 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:12 user nova-compute[71206]:     </video>
Jul 27 18:00:12 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:00:12 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:00:12 user nova-compute[71206]:     </rng>
Jul 27 18:00:12 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:00:12 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:00:12 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:00:12 user nova-compute[71206]:     </memballoon>
Jul 27 18:00:12 user nova-compute[71206]:   </devices>
Jul 27 18:00:12 user nova-compute[71206]: </domain>
Jul 27 18:00:12 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-6788576',display_name='tempest-VolumesAdminNegativeTest-server-6788576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-6788576',id=10,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfaOx8StgDGvN7b6iACZBDEuWkxCeDl89+w0LfAzbFMyCxrEonIet76dx3MfwX4Xfb3JAKG8e50e9f6bbpThUkQmK8I9p2HXy/1ipDBxWI/WIyPNlce3EHwzZ27PdyfKA==',key_name='tempest-keypair-800891234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-jg6jejd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204444b73ce844fd9514fcc031569ae4',uuid=80b19738-1683-4af2-a706-4ec8d9fd24e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG os_vif [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3a08c29-ae, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3a08c29-ae, col_values=(('external_ids', {'iface-id': 'f3a08c29-ae46-4a09-936a-142747a0b0e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:2b:53', 'vm-uuid': '80b19738-1683-4af2-a706-4ec8d9fd24e5'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:12 user nova-compute[71206]: INFO os_vif [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae')
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No VIF found with MAC fa:16:3e:ab:2b:53, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:00:12 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Creating config drive at /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config
Jul 27 18:00:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnkf4mxx8 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnkf4mxx8" returned: 0 in 0.063s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updated VIF entry in instance network info cache for port 2846403b-4b4b-45d6-913f-aca6ec36385e. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c147cba0-980f-48f7-b63d-d72510f9a5b5 req-4c247701-552b-4ca6-a768-7cf9774be9cc service nova] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updated VIF entry in instance network info cache for port f3a08c29-ae46-4a09-936a-142747a0b0e7. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updating instance_info_cache with network_info: [{"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:00:13 user nova-compute[71206]: INFO nova.compute.claims [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Claim successful on node user
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-37d8677a-9b0e-449e-887e-22559036d7e6 req-fb4a5b42-2a9b-4cf6-b1e8-e57583c20f59 service nova] Releasing lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Successfully updated port: 107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquired lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-changed-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Refreshing instance network info cache due to event network-changed-107fcac0-825a-4a40-a7fa-c5a1ae4a5965. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] Acquiring lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:00:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.policy [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '334f1dea9095424eb0dc1d03623b2236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca32306d231b4555aa6fdaa714432969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating instance_info_cache with network_info: [{"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Releasing lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Instance network_info: |[{"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] Acquired lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.network.neutron [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Refreshing network info cache for port 107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Start _get_guest_xml network_info=[{"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:00:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Creating image(s)
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "5fc79a65a9d5245e21859fe67a113201f0a42991" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "5fc79a65a9d5245e21859fe67a113201f0a42991" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:14 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:14 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1554878388',display_name='tempest-TestVolumeSwap-server-1554878388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1554878388',id=11,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIykvBP6jheYFTgbyMZ5unJLexq4JcgD4v189y5h0/HdrBFIofPX1ndIvTtz2QIZtqVcoUw9OSSbVr1c/YRute8WDFy9SByZh1MNXN9RAXVgq669Ggoffho7SDFb9ylr6w==',key_name='tempest-keypair-933434411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cd5677e4fd84943a4ddd1ae7c1e737a',ramdisk_id='',reservation_id='r-gusrkjpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-386645751',owner_user_name='tempest-TestVolumeSwap-386645751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825130825ff442898bc4783be5a45a43',uuid=24390c1b-61e1-4a56-92ae-cd7b79e67da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converting VIF {"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG nova.objects.instance [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'pci_devices' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:00:15 user nova-compute[71206]:   <uuid>24390c1b-61e1-4a56-92ae-cd7b79e67da6</uuid>
Jul 27 18:00:15 user nova-compute[71206]:   <name>instance-0000000b</name>
Jul 27 18:00:15 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:00:15 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:00:15 user nova-compute[71206]:   <metadata>
Jul 27 18:00:15 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:00:15 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:name>tempest-TestVolumeSwap-server-1554878388</nova:name>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:00:14</nova:creationTime>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:00:15 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:00:15 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:owner>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:user uuid="825130825ff442898bc4783be5a45a43">tempest-TestVolumeSwap-386645751-project-member</nova:user>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:project uuid="9cd5677e4fd84943a4ddd1ae7c1e737a">tempest-TestVolumeSwap-386645751</nova:project>
Jul 27 18:00:15 user nova-compute[71206]:       </nova:owner>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:00:15 user nova-compute[71206]:       <nova:ports>
Jul 27 18:00:15 user nova-compute[71206]:         <nova:port uuid="107fcac0-825a-4a40-a7fa-c5a1ae4a5965">
Jul 27 18:00:15 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 18:00:15 user nova-compute[71206]:         </nova:port>
Jul 27 18:00:15 user nova-compute[71206]:       </nova:ports>
Jul 27 18:00:15 user nova-compute[71206]:     </nova:instance>
Jul 27 18:00:15 user nova-compute[71206]:   </metadata>
Jul 27 18:00:15 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:00:15 user nova-compute[71206]:     <system>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="serial">24390c1b-61e1-4a56-92ae-cd7b79e67da6</entry>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="uuid">24390c1b-61e1-4a56-92ae-cd7b79e67da6</entry>
Jul 27 18:00:15 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:00:15 user nova-compute[71206]:     </system>
Jul 27 18:00:15 user nova-compute[71206]:   </sysinfo>
Jul 27 18:00:15 user nova-compute[71206]:   <os>
Jul 27 18:00:15 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:00:15 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:00:15 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:00:15 user nova-compute[71206]:   </os>
Jul 27 18:00:15 user nova-compute[71206]:   <features>
Jul 27 18:00:15 user nova-compute[71206]:     <acpi/>
Jul 27 18:00:15 user nova-compute[71206]:     <apic/>
Jul 27 18:00:15 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:00:15 user nova-compute[71206]:   </features>
Jul 27 18:00:15 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:00:15 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:00:15 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:00:15 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:00:15 user nova-compute[71206]:   </clock>
Jul 27 18:00:15 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:00:15 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:00:15 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:00:15 user nova-compute[71206]:   </cpu>
Jul 27 18:00:15 user nova-compute[71206]:   <devices>
Jul 27 18:00:15 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:00:15 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:00:15 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk"/>
Jul 27 18:00:15 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:00:15 user nova-compute[71206]:     </disk>
Jul 27 18:00:15 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:00:15 user nova-compute[71206]:       <mac address="fa:16:3e:b4:ea:41"/>
Jul 27 18:00:15 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:15 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:00:15 user nova-compute[71206]:       <target dev="tap107fcac0-82"/>
Jul 27 18:00:15 user nova-compute[71206]:     </interface>
Jul 27 18:00:15 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:00:15 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/console.log" append="off"/>
Jul 27 18:00:15 user nova-compute[71206]:     </serial>
Jul 27 18:00:15 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:00:15 user nova-compute[71206]:     <video>
Jul 27 18:00:15 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:15 user nova-compute[71206]:     </video>
Jul 27 18:00:15 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:00:15 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:00:15 user nova-compute[71206]:     </rng>
Jul 27 18:00:15 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:00:15 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:00:15 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:00:15 user nova-compute[71206]:     </memballoon>
Jul 27 18:00:15 user nova-compute[71206]:   </devices>
Jul 27 18:00:15 user nova-compute[71206]: </domain>
Jul 27 18:00:15 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1554878388',display_name='tempest-TestVolumeSwap-server-1554878388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1554878388',id=11,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIykvBP6jheYFTgbyMZ5unJLexq4JcgD4v189y5h0/HdrBFIofPX1ndIvTtz2QIZtqVcoUw9OSSbVr1c/YRute8WDFy9SByZh1MNXN9RAXVgq669Ggoffho7SDFb9ylr6w==',key_name='tempest-keypair-933434411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cd5677e4fd84943a4ddd1ae7c1e737a',ramdisk_id='',reservation_id='r-gusrkjpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-386645751',owner_user_name='tempest-TestVolumeSwap-386645751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825130825ff442898bc4783be5a45a43',uuid=24390c1b-61e1-4a56-92ae-cd7b79e67da6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converting VIF {"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG os_vif [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap107fcac0-82, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap107fcac0-82, col_values=(('external_ids', {'iface-id': '107fcac0-825a-4a40-a7fa-c5a1ae4a5965', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ea:41', 'vm-uuid': '24390c1b-61e1-4a56-92ae-cd7b79e67da6'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: INFO os_vif [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82')
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.part --force-share --output=json" returned: 0 in 0.231s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.virt.images [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] 7aa25195-27a5-4dcd-aa47-f0736761d20d was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.part /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:15 user nova-compute[71206]: WARNING nova.compute.manager [req-7fe377b3-a4f6-4ea1-bff4-e2a26cc62072 req-85a7235b-7c63-4866-b5b3-5b5571d46ec5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e for instance with vm_state building and task_state spawning.
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] No VIF found with MAC fa:16:3e:b4:ea:41, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.part /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.converted" returned: 0 in 0.378s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Successfully created port: 56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "5fc79a65a9d5245e21859fe67a113201f0a42991" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.421s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "5fc79a65a9d5245e21859fe67a113201f0a42991" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "5fc79a65a9d5245e21859fe67a113201f0a42991" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991,backing_fmt=raw /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991,backing_fmt=raw /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk 1073741824" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "5fc79a65a9d5245e21859fe67a113201f0a42991" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 --force-share --output=json" returned: 0 in 0.187s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] No waiting events found dispatching network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:16 user nova-compute[71206]: WARNING nova.compute.manager [req-0f722de9-4811-4323-8440-e62de4e7430c req-ea8d4d6a-9934-4c26-b4ff-c24e87226d48 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received unexpected event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 for instance with vm_state building and task_state spawning.
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Cannot resize image /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'migration_context' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Ensure instance console log exists: /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updated VIF entry in instance network info cache for port 107fcac0-825a-4a40-a7fa-c5a1ae4a5965. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating instance_info_cache with network_info: [{"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-27ba5d66-2716-4e92-88ee-11bd251a52d7 req-206f8afc-f6c5-476a-9c5c-c9fa85af3b06 service nova] Releasing lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:17 user nova-compute[71206]: WARNING nova.compute.manager [req-2334d35b-a7ad-46a6-b207-133ed1077410 req-9937f665-1589-4e83-8bd0-53e6b3d6aef6 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e for instance with vm_state building and task_state spawning.
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Successfully updated port: 56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquired lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] No waiting events found dispatching network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:17 user nova-compute[71206]: WARNING nova.compute.manager [req-5c6e6841-4a94-43b6-94f3-5a2106214096 req-f395b2ea-59d5-4e71-a3c9-979a36c4feeb service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received unexpected event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 for instance with vm_state building and task_state spawning.
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updating instance_info_cache with network_info: [{"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Releasing lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Instance network_info: |[{"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Start _get_guest_xml network_info=[{"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:00:02Z,direct_url=<?>,disk_format='qcow2',id=7aa25195-27a5-4dcd-aa47-f0736761d20d,min_disk=0,min_ram=0,name='',owner='7c133528eff649e2852013f83ddd58a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:00:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/sda', 'image_id': '7aa25195-27a5-4dcd-aa47-f0736761d20d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:00:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:00:02Z,direct_url=<?>,disk_format='qcow2',id=7aa25195-27a5-4dcd-aa47-f0736761d20d,min_disk=0,min_ram=0,name='',owner='7c133528eff649e2852013f83ddd58a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:00:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-782799389',display_name='tempest-AttachSCSIVolumeTestJSON-server-782799389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-782799389',id=12,image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOffYtYiRVi7ryqXefpwDZLXVSCzoIexZ2QquXpStKhKs3atb7HrKZfvkBO75BWiv1zIwpU2bmVKCmkIMQt7eS49n73eq4FHQ4lRcPy89ob+m2kKOS6ix51uM/ouzCB02g==',key_name='tempest-keypair-924617423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca32306d231b4555aa6fdaa714432969',ramdisk_id='',reservation_id='r-q2xbrurm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1701240709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1701240709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='334f1dea9095424eb0dc1d03623b2236',uuid=de639534-60e8-4cd1-bcc8-92a29efd0610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converting VIF {"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.objects.instance [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'pci_devices' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:00:18 user nova-compute[71206]:   <uuid>de639534-60e8-4cd1-bcc8-92a29efd0610</uuid>
Jul 27 18:00:18 user nova-compute[71206]:   <name>instance-0000000c</name>
Jul 27 18:00:18 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:00:18 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:00:18 user nova-compute[71206]:   <metadata>
Jul 27 18:00:18 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:00:18 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-782799389</nova:name>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:00:18</nova:creationTime>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:00:18 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:00:18 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:owner>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:user uuid="334f1dea9095424eb0dc1d03623b2236">tempest-AttachSCSIVolumeTestJSON-1701240709-project-member</nova:user>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:project uuid="ca32306d231b4555aa6fdaa714432969">tempest-AttachSCSIVolumeTestJSON-1701240709</nova:project>
Jul 27 18:00:18 user nova-compute[71206]:       </nova:owner>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:root type="image" uuid="7aa25195-27a5-4dcd-aa47-f0736761d20d"/>
Jul 27 18:00:18 user nova-compute[71206]:       <nova:ports>
Jul 27 18:00:18 user nova-compute[71206]:         <nova:port uuid="56c61374-8bca-47a0-af37-41ee6e2ea991">
Jul 27 18:00:18 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:00:18 user nova-compute[71206]:         </nova:port>
Jul 27 18:00:18 user nova-compute[71206]:       </nova:ports>
Jul 27 18:00:18 user nova-compute[71206]:     </nova:instance>
Jul 27 18:00:18 user nova-compute[71206]:   </metadata>
Jul 27 18:00:18 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:00:18 user nova-compute[71206]:     <system>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="serial">de639534-60e8-4cd1-bcc8-92a29efd0610</entry>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="uuid">de639534-60e8-4cd1-bcc8-92a29efd0610</entry>
Jul 27 18:00:18 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:00:18 user nova-compute[71206]:     </system>
Jul 27 18:00:18 user nova-compute[71206]:   </sysinfo>
Jul 27 18:00:18 user nova-compute[71206]:   <os>
Jul 27 18:00:18 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:00:18 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:00:18 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:00:18 user nova-compute[71206]:   </os>
Jul 27 18:00:18 user nova-compute[71206]:   <features>
Jul 27 18:00:18 user nova-compute[71206]:     <acpi/>
Jul 27 18:00:18 user nova-compute[71206]:     <apic/>
Jul 27 18:00:18 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:00:18 user nova-compute[71206]:   </features>
Jul 27 18:00:18 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:00:18 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:00:18 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:00:18 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:00:18 user nova-compute[71206]:   </clock>
Jul 27 18:00:18 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:00:18 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:00:18 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:00:18 user nova-compute[71206]:   </cpu>
Jul 27 18:00:18 user nova-compute[71206]:   <devices>
Jul 27 18:00:18 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:00:18 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:00:18 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk"/>
Jul 27 18:00:18 user nova-compute[71206]:       <target dev="sda" bus="scsi"/>
Jul 27 18:00:18 user nova-compute[71206]:       <address type="drive" controller="0" unit="0"/>
Jul 27 18:00:18 user nova-compute[71206]:     </disk>
Jul 27 18:00:18 user nova-compute[71206]:     <disk type="file" device="cdrom">
Jul 27 18:00:18 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 18:00:18 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.config"/>
Jul 27 18:00:18 user nova-compute[71206]:       <target dev="sdb" bus="scsi"/>
Jul 27 18:00:18 user nova-compute[71206]:       <address type="drive" controller="0" unit="1"/>
Jul 27 18:00:18 user nova-compute[71206]:     </disk>
Jul 27 18:00:18 user nova-compute[71206]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 27 18:00:18 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:00:18 user nova-compute[71206]:       <mac address="fa:16:3e:28:70:60"/>
Jul 27 18:00:18 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:18 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:00:18 user nova-compute[71206]:       <target dev="tap56c61374-8b"/>
Jul 27 18:00:18 user nova-compute[71206]:     </interface>
Jul 27 18:00:18 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:00:18 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/console.log" append="off"/>
Jul 27 18:00:18 user nova-compute[71206]:     </serial>
Jul 27 18:00:18 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:00:18 user nova-compute[71206]:     <video>
Jul 27 18:00:18 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:00:18 user nova-compute[71206]:     </video>
Jul 27 18:00:18 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:00:18 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:00:18 user nova-compute[71206]:     </rng>
Jul 27 18:00:18 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:00:18 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:00:18 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:00:18 user nova-compute[71206]:     </memballoon>
Jul 27 18:00:18 user nova-compute[71206]:   </devices>
Jul 27 18:00:18 user nova-compute[71206]: </domain>
Jul 27 18:00:18 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-782799389',display_name='tempest-AttachSCSIVolumeTestJSON-server-782799389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-782799389',id=12,image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOffYtYiRVi7ryqXefpwDZLXVSCzoIexZ2QquXpStKhKs3atb7HrKZfvkBO75BWiv1zIwpU2bmVKCmkIMQt7eS49n73eq4FHQ4lRcPy89ob+m2kKOS6ix51uM/ouzCB02g==',key_name='tempest-keypair-924617423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca32306d231b4555aa6fdaa714432969',ramdisk_id='',reservation_id='r-q2xbrurm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1701240709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1701240709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='334f1dea9095424eb0dc1d03623b2236',uuid=de639534-60e8-4cd1-bcc8-92a29efd0610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converting VIF {"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG os_vif [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c61374-8b, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56c61374-8b, col_values=(('external_ids', {'iface-id': '56c61374-8bca-47a0-af37-41ee6e2ea991', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:70:60', 'vm-uuid': 'de639534-60e8-4cd1-bcc8-92a29efd0610'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: INFO os_vif [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b')
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No BDM found with device name sda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No VIF found with MAC fa:16:3e:28:70:60, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:00:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Using config drive
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Creating config drive at /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.config
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp52xchvr7 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp52xchvr7" returned: 0 in 0.071s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] No waiting events found dispatching network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:18 user nova-compute[71206]: WARNING nova.compute.manager [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received unexpected event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 for instance with vm_state building and task_state spawning.
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-changed-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Refreshing instance network info cache due to event network-changed-56c61374-8bca-47a0-af37-41ee6e2ea991. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Acquiring lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Acquired lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:18 user nova-compute[71206]: DEBUG nova.network.neutron [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Refreshing network info cache for port 56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.network.neutron [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updated VIF entry in instance network info cache for port 56c61374-8bca-47a0-af37-41ee6e2ea991. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.network.neutron [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updating instance_info_cache with network_info: [{"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f21af547-2d8e-4b9f-a08b-985c62e89d6e req-d0c4ea1a-096c-4ef8-89dd-b0a846bcbfd3 service nova] Releasing lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480819.7374434, 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] VM Resumed (Lifecycle Event)
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Instance spawned successfully.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Instance spawned successfully.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480819.7393122, 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] VM Started (Lifecycle Event)
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480819.749789, 80b19738-1683-4af2-a706-4ec8d9fd24e5 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] VM Resumed (Lifecycle Event)
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Took 16.38 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Took 18.26 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480819.7536225, 80b19738-1683-4af2-a706-4ec8d9fd24e5 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] VM Started (Lifecycle Event)
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Took 20.34 seconds to build instance.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Took 19.83 seconds to build instance.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-567d7b2d-268c-4480-93d1-ee59bbde1a5f tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.587s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-61ca01e9-7918-46ca-9441-ba206e8f44c3 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.100s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] No waiting events found dispatching network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:20 user nova-compute[71206]: WARNING nova.compute.manager [req-76b0e9b7-827b-41be-b774-99468f8549bc req-04a9e1ed-d446-48c2-bc01-a0b22e7b0e53 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received unexpected event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 for instance with vm_state building and task_state spawning.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480820.4010317, 24390c1b-61e1-4a56-92ae-cd7b79e67da6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] VM Resumed (Lifecycle Event)
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Instance spawned successfully.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480820.4033847, 24390c1b-61e1-4a56-92ae-cd7b79e67da6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] VM Started (Lifecycle Event)
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Took 12.89 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:20 user nova-compute[71206]: INFO nova.compute.manager [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Took 14.79 seconds to build instance.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] No waiting events found dispatching network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:20 user nova-compute[71206]: WARNING nova.compute.manager [req-49d81217-3e27-4266-8018-d9a08bfaed7b req-49bb21c9-c9de-47c9-a463-2df349aa24e1 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received unexpected event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 for instance with vm_state building and task_state spawning.
Jul 27 18:00:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48c65e4b-cfdd-4204-9f40-68d56b40d855 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.992s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480822.8768141, de639534-60e8-4cd1-bcc8-92a29efd0610 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:22 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] VM Resumed (Lifecycle Event)
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Instance spawned successfully.
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] No waiting events found dispatching network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:00:22 user nova-compute[71206]: WARNING nova.compute.manager [req-bd45db35-8bc1-4264-b053-5b4f95204a34 req-401ec252-ed54-4aae-b16e-625dfbf190c8 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received unexpected event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 for instance with vm_state building and task_state spawning.
Jul 27 18:00:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:23 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480822.8831854, de639534-60e8-4cd1-bcc8-92a29efd0610 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:00:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] VM Started (Lifecycle Event)
Jul 27 18:00:23 user nova-compute[71206]: INFO nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Took 8.69 seconds to spawn the instance on the hypervisor.
Jul 27 18:00:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:00:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:23 user nova-compute[71206]: INFO nova.compute.manager [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Took 10.09 seconds to build instance.
Jul 27 18:00:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68dcaff7-9d1f-4c89-8ed3-9a45a0f99efa tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.249s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:00:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:00:26 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:26 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:00:26 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7155MB free_disk=25.824764251708984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:00:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:00:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance eab112a5-6c8d-4d54-86f9-15e28491d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d1c93904-5854-4093-a782-58723eb98bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance de639534-60e8-4cd1-bcc8-92a29efd0610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:00:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.139s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:00:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid db540ca5-3de8-47c3-968d-402bf58f5d6f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updating instance_info_cache with network_info: [{"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-db540ca5-3de8-47c3-968d-402bf58f5d6f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:00:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:00:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:00:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:01:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:01:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:21 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:01:23 user nova-compute[71206]: INFO nova.compute.claims [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Claim successful on node user
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:01:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:01:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:01:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Creating image(s)
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "/opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "/opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.policy [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acff3e99b9914903bbc46a86236c161f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df66e0d4db9e4423975377161874c03a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.184s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk 1073741824" returned: 0 in 0.051s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: INFO nova.compute.manager [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] instance snapshotting
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.228s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Cannot resize image /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'migration_context' on Instance uuid a9eaffca-4af0-4208-95be-2894eec95276 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Beginning live snapshot process
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Ensure instance console log exists: /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224.delta 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224.delta 1073741824" returned: 0 in 0.045s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 18:01:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71206) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 27 18:01:25 user nova-compute[71206]: INFO nova.virt.libvirt.host [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] UEFI support detected
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Successfully created port: 524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-changed-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Refreshing instance network info cache due to event network-changed-cc85a1c7-e1be-4e96-9640-8be9a65a8174. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.network.neutron [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Refreshing network info cache for port cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:26 user nova-compute[71206]: INFO nova.compute.manager [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Rescuing
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:01:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] COPY block job progress, current cursor: 2883584 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.566s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:01:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224.delta /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updated VIF entry in instance network info cache for port cc85a1c7-e1be-4e96-9640-8be9a65a8174. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Successfully updated port: 524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224.delta /opt/stack/data/nova/instances/snapshots/tmp7fky46e_/b835b9e9a98b4b17b81604d3cd154224" returned: 0 in 1.052s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing instance network info cache due to event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-changed-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Refreshing instance network info cache due to event network-changed-524f882c-25b7-4ab0-b120-ad47d70e0b47. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] Acquiring lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] Acquired lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Refreshing network info cache for port 524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Snapshot extracted, beginning image upload
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ab3e49e6-2f04-4816-a8b2-f2aa30b1e210 req-8872ef5c-8a09-42a4-a9d4-5236d5e7072f service nova] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=6522MB free_disk=25.689693450927734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lazy-loading 'flavor' on Instance uuid eab112a5-6c8d-4d54-86f9-15e28491d037 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance eab112a5-6c8d-4d54-86f9-15e28491d037 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d1c93904-5854-4093-a782-58723eb98bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance de639534-60e8-4cd1-bcc8-92a29efd0610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a9eaffca-4af0-4208-95be-2894eec95276 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:28 user nova-compute[71206]: INFO nova.compute.manager [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Attaching volume 224257fc-e5ca-43a0-92a9-3e17f12b1a57 to /dev/vdb
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG os_brick.utils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:29 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1evqludx/privsep.sock']
Jul 27 18:01:29 user sudo[83066]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1evqludx/privsep.sock
Jul 27 18:01:29 user sudo[83066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:29 user nova-compute[71206]: INFO nova.compute.manager [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] instance snapshotting
Jul 27 18:01:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Beginning live snapshot process
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-86bcaf4a-3123-4934-a450-a2287792ac73 req-a2cd59d2-1f20-4537-8b74-76d823c91999 service nova] Releasing lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquired lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing instance network info cache due to event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance destroyed successfully.
Jul 27 18:01:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Attempting rescue
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:01:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Creating image(s)
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.202s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656.delta 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updated VIF entry in instance network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656.delta 1073741824" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7893627-a2f0-4a11-8379-01793292e259 req-b104b06e-f913-42b1-9415-449c26de7a45 service nova] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue" returned: 0 in 0.053s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start _get_guest_xml network_info=[{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:fc:53:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:30 user nova-compute[71206]: WARNING nova.compute.manager [req-20845af3-a7b5-4f6f-8239-1ff3f7c6fb87 req-296a9b7c-780d-476a-af8a-9659603f077e service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state active and task_state rescuing.
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'numa_topology' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1086757011',display_name='tempest-ServerRescueNegativeTestJSON-server-1086757011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1086757011',id=8,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-g2cpq40t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:57Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=f4daa5a7-ada3-4d66-a84b-ac02d78220a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:fc:53:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:fc:53:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:01:30 user nova-compute[71206]:   <uuid>f4daa5a7-ada3-4d66-a84b-ac02d78220a9</uuid>
Jul 27 18:01:30 user nova-compute[71206]:   <name>instance-00000008</name>
Jul 27 18:01:30 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:01:30 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:01:30 user nova-compute[71206]:   <metadata>
Jul 27 18:01:30 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:01:30 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1086757011</nova:name>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:01:30</nova:creationTime>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:01:30 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:01:30 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:owner>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 18:01:30 user nova-compute[71206]:       </nova:owner>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:01:30 user nova-compute[71206]:       <nova:ports>
Jul 27 18:01:30 user nova-compute[71206]:         <nova:port uuid="4167e460-cbf2-4ff6-b173-a5318f5e3b6c">
Jul 27 18:01:30 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 18:01:30 user nova-compute[71206]:         </nova:port>
Jul 27 18:01:30 user nova-compute[71206]:       </nova:ports>
Jul 27 18:01:30 user nova-compute[71206]:     </nova:instance>
Jul 27 18:01:30 user nova-compute[71206]:   </metadata>
Jul 27 18:01:30 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:01:30 user nova-compute[71206]:     <system>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="serial">f4daa5a7-ada3-4d66-a84b-ac02d78220a9</entry>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="uuid">f4daa5a7-ada3-4d66-a84b-ac02d78220a9</entry>
Jul 27 18:01:30 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:01:30 user nova-compute[71206]:     </system>
Jul 27 18:01:30 user nova-compute[71206]:   </sysinfo>
Jul 27 18:01:30 user nova-compute[71206]:   <os>
Jul 27 18:01:30 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:01:30 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:01:30 user nova-compute[71206]:   </os>
Jul 27 18:01:30 user nova-compute[71206]:   <features>
Jul 27 18:01:30 user nova-compute[71206]:     <acpi/>
Jul 27 18:01:30 user nova-compute[71206]:     <apic/>
Jul 27 18:01:30 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:01:30 user nova-compute[71206]:   </features>
Jul 27 18:01:30 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:01:30 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:01:30 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:01:30 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:01:30 user nova-compute[71206]:   </clock>
Jul 27 18:01:30 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:01:30 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:01:30 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:01:30 user nova-compute[71206]:   </cpu>
Jul 27 18:01:30 user nova-compute[71206]:   <devices>
Jul 27 18:01:30 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:01:30 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:01:30 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue"/>
Jul 27 18:01:30 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:01:30 user nova-compute[71206]:     </disk>
Jul 27 18:01:30 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:01:30 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:01:30 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk"/>
Jul 27 18:01:30 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:01:30 user nova-compute[71206]:     </disk>
Jul 27 18:01:30 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:01:30 user nova-compute[71206]:       <mac address="fa:16:3e:fc:53:81"/>
Jul 27 18:01:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:01:30 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:01:30 user nova-compute[71206]:       <target dev="tap4167e460-cb"/>
Jul 27 18:01:30 user nova-compute[71206]:     </interface>
Jul 27 18:01:30 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:01:30 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/console.log" append="off"/>
Jul 27 18:01:30 user nova-compute[71206]:     </serial>
Jul 27 18:01:30 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:01:30 user nova-compute[71206]:     <video>
Jul 27 18:01:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:01:30 user nova-compute[71206]:     </video>
Jul 27 18:01:30 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:01:30 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:01:30 user nova-compute[71206]:     </rng>
Jul 27 18:01:30 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:01:30 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:01:30 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:01:30 user nova-compute[71206]:     </memballoon>
Jul 27 18:01:30 user nova-compute[71206]:   </devices>
Jul 27 18:01:30 user nova-compute[71206]: </domain>
Jul 27 18:01:30 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:01:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance destroyed successfully.
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:fc:53:81, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Updating instance_info_cache with network_info: [{"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Releasing lock "refresh_cache-a9eaffca-4af0-4208-95be-2894eec95276" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance network_info: |[{"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Start _get_guest_xml network_info=[{"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:01:31 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:31 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2123453327',display_name='tempest-ServersNegativeTestJSON-server-2123453327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2123453327',id=13,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-zfu9ifa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:01:24Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=a9eaffca-4af0-4208-95be-2894eec95276,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'pci_devices' on Instance uuid a9eaffca-4af0-4208-95be-2894eec95276 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:01:31 user nova-compute[71206]:   <uuid>a9eaffca-4af0-4208-95be-2894eec95276</uuid>
Jul 27 18:01:31 user nova-compute[71206]:   <name>instance-0000000d</name>
Jul 27 18:01:31 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:01:31 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:01:31 user nova-compute[71206]:   <metadata>
Jul 27 18:01:31 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:01:31 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:name>tempest-ServersNegativeTestJSON-server-2123453327</nova:name>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:01:31</nova:creationTime>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:01:31 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:01:31 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:owner>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:user uuid="acff3e99b9914903bbc46a86236c161f">tempest-ServersNegativeTestJSON-1056680897-project-member</nova:user>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:project uuid="df66e0d4db9e4423975377161874c03a">tempest-ServersNegativeTestJSON-1056680897</nova:project>
Jul 27 18:01:31 user nova-compute[71206]:       </nova:owner>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:01:31 user nova-compute[71206]:       <nova:ports>
Jul 27 18:01:31 user nova-compute[71206]:         <nova:port uuid="524f882c-25b7-4ab0-b120-ad47d70e0b47">
Jul 27 18:01:31 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:01:31 user nova-compute[71206]:         </nova:port>
Jul 27 18:01:31 user nova-compute[71206]:       </nova:ports>
Jul 27 18:01:31 user nova-compute[71206]:     </nova:instance>
Jul 27 18:01:31 user nova-compute[71206]:   </metadata>
Jul 27 18:01:31 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:01:31 user nova-compute[71206]:     <system>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="serial">a9eaffca-4af0-4208-95be-2894eec95276</entry>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="uuid">a9eaffca-4af0-4208-95be-2894eec95276</entry>
Jul 27 18:01:31 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:01:31 user nova-compute[71206]:     </system>
Jul 27 18:01:31 user nova-compute[71206]:   </sysinfo>
Jul 27 18:01:31 user nova-compute[71206]:   <os>
Jul 27 18:01:31 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:01:31 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:01:31 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:01:31 user nova-compute[71206]:   </os>
Jul 27 18:01:31 user nova-compute[71206]:   <features>
Jul 27 18:01:31 user nova-compute[71206]:     <acpi/>
Jul 27 18:01:31 user nova-compute[71206]:     <apic/>
Jul 27 18:01:31 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:01:31 user nova-compute[71206]:   </features>
Jul 27 18:01:31 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:01:31 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:01:31 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:01:31 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:01:31 user nova-compute[71206]:   </clock>
Jul 27 18:01:31 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:01:31 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:01:31 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:01:31 user nova-compute[71206]:   </cpu>
Jul 27 18:01:31 user nova-compute[71206]:   <devices>
Jul 27 18:01:31 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:01:31 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:01:31 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk"/>
Jul 27 18:01:31 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:01:31 user nova-compute[71206]:     </disk>
Jul 27 18:01:31 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:01:31 user nova-compute[71206]:       <mac address="fa:16:3e:93:cc:4b"/>
Jul 27 18:01:31 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:01:31 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:01:31 user nova-compute[71206]:       <target dev="tap524f882c-25"/>
Jul 27 18:01:31 user nova-compute[71206]:     </interface>
Jul 27 18:01:31 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:01:31 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/console.log" append="off"/>
Jul 27 18:01:31 user nova-compute[71206]:     </serial>
Jul 27 18:01:31 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:01:31 user nova-compute[71206]:     <video>
Jul 27 18:01:31 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:01:31 user nova-compute[71206]:     </video>
Jul 27 18:01:31 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:01:31 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:01:31 user nova-compute[71206]:     </rng>
Jul 27 18:01:31 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:01:31 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:01:31 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:01:31 user nova-compute[71206]:     </memballoon>
Jul 27 18:01:31 user nova-compute[71206]:   </devices>
Jul 27 18:01:31 user nova-compute[71206]: </domain>
Jul 27 18:01:31 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2123453327',display_name='tempest-ServersNegativeTestJSON-server-2123453327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2123453327',id=13,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-zfu9ifa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:01:24Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=a9eaffca-4af0-4208-95be-2894eec95276,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG os_vif [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap524f882c-25, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap524f882c-25, col_values=(('external_ids', {'iface-id': '524f882c-25b7-4ab0-b120-ad47d70e0b47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:cc:4b', 'vm-uuid': 'a9eaffca-4af0-4208-95be-2894eec95276'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:31 user nova-compute[71206]: INFO os_vif [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25')
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] No VIF found with MAC fa:16:3e:93:cc:4b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updated VIF entry in instance network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a453aaed-7700-4a22-adb3-946cfc6295dc req-bd36a379-20f6-4b37-aec5-d1c9d4d989ec service nova] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:31 user sudo[83066]: pam_unix(sudo:session): session closed for user root
Jul 27 18:01:31 user nova-compute[71206]: INFO oslo.privsep.daemon [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Spawned new privsep daemon via rootwrap
Jul 27 18:01:31 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 18:01:31 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 18:01:31 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 27 18:01:31 user nova-compute[71206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83159
Jul 27 18:01:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dcb60f-cd71-4aa1-8a1d-589845692eb7]: (2,) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:01:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 18:01:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Snapshot image upload complete
Jul 27 18:01:31 user nova-compute[71206]: INFO nova.compute.manager [None req-d959c5d4-2441-4061-bd42-fbd2dac2f35f tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Took 7.10 seconds to snapshot the instance on the hypervisor.
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5889d13b-9f6d-4bd4-a908-9b0c45ae7006]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.nvmeof [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7c5af-2822-4019-a136-f39ac95aafc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ecf34-54b8-4f1b-a02d-0d08891aa888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3911a18-ed58-474b-9d2a-33509ca64fe9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:32 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f512ad6-4156-44d6-9fb2-4d014c166c94]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG os_brick.utils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] <== get_connector_properties: return (3086ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updating existing volume attachment record: 43896391-820a-49b9-ba1d-cdd3e008d7f1 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656.delta /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656.delta /opt/stack/data/nova/instances/snapshots/tmp8skubzbz/d4b6ea32483043bb801b450cd2ddb656" returned: 0 in 0.236s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:32 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Snapshot extracted, beginning image upload
Jul 27 18:01:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:32 user nova-compute[71206]: WARNING nova.compute.manager [req-1a5dc542-8da1-4476-aa49-5c28464fe28f req-7a3887e7-6249-40fe-a684-bdaf4ddecff6 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state active and task_state rescuing.
Jul 27 18:01:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:33 user nova-compute[71206]: INFO nova.compute.manager [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Shelving
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:33 user nova-compute[71206]: WARNING nova.compute.manager [req-29584a85-a54a-4713-8d61-2e4fc09d3d00 req-50ee369f-8359-4d80-b640-d7685a625260 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state active and task_state shelving.
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance destroyed successfully.
Jul 27 18:01:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Beginning cold snapshot process
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk /opt/stack/data/nova/instances/snapshots/tmpn4j3nf_c/d2da632cb0c44e249ad8b0f4099ee9d8 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:34 user nova-compute[71206]: WARNING nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state active and task_state rescuing.
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:34 user nova-compute[71206]: WARNING nova.compute.manager [req-dcf22377-4f75-4ec2-90d3-0ee4d7a50e18 req-c5c6e083-1371-4b5d-ad44-be50ce632f23 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state active and task_state rescuing.
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] No waiting events found dispatching network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:34 user nova-compute[71206]: WARNING nova.compute.manager [req-b40bdc09-7484-487e-b6d4-8fc1c7301276 req-888733a2-c76a-4b0a-9c03-e5a6bb681df4 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received unexpected event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 for instance with vm_state building and task_state spawning.
Jul 27 18:01:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk /opt/stack/data/nova/instances/snapshots/tmpn4j3nf_c/d2da632cb0c44e249ad8b0f4099ee9d8" returned: 0 in 0.647s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:35 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Snapshot extracted, beginning image upload
Jul 27 18:01:35 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Snapshot image upload complete
Jul 27 18:01:35 user nova-compute[71206]: INFO nova.compute.manager [None req-391b82f6-174c-437c-b562-52b4e5ae504e tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Took 5.71 seconds to snapshot the instance on the hypervisor.
Jul 27 18:01:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:35 user nova-compute[71206]: WARNING nova.compute.manager [req-fd6aa86e-d3ac-4432-b2f6-28ef393ed8bb req-e61eceb5-9000-4a49-bde4-8f9bd0ae826a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 18:01:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] No waiting events found dispatching network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:36 user nova-compute[71206]: WARNING nova.compute.manager [req-c4f3a733-543f-4a33-8581-670f042cfcff req-8b10c231-960f-4acd-84fe-6222ee4d77af service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received unexpected event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 for instance with vm_state building and task_state spawning.
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for f4daa5a7-ada3-4d66-a84b-ac02d78220a9 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480896.8289251, f4daa5a7-ada3-4d66-a84b-ac02d78220a9 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:01:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] VM Resumed (Lifecycle Event)
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bcb85176-e095-4753-b905-eb70e2063423 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:01:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480896.830215, f4daa5a7-ada3-4d66-a84b-ac02d78220a9 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:01:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] VM Started (Lifecycle Event)
Jul 27 18:01:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance spawned successfully.
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480896.8820333, a9eaffca-4af0-4208-95be-2894eec95276 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] VM Resumed (Lifecycle Event)
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480896.8835418, a9eaffca-4af0-4208-95be-2894eec95276 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] VM Started (Lifecycle Event)
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Took 13.02 seconds to spawn the instance on the hypervisor.
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Took 14.14 seconds to build instance.
Jul 27 18:01:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1ad017d8-16d3-46ae-8127-242e726cab9c tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.262s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Snapshot image upload complete
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.compute.manager [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Shelve offloading
Jul 27 18:01:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance destroyed successfully.
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:01:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:38 user nova-compute[71206]: DEBUG nova.network.neutron [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:39 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance destroyed successfully.
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.objects.instance [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'resources' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpXpxN//cqXL2CbTzpUViRWm87TtCfzxyOaA9/zigvj4d6W8AOBPdsnY2L0TfwW1qpHr7QA5x4Uk3a/uAmbpFu8TjE3F7Kv397LxSZ520rqGXuIaO8SvoyAi/kAb/blzw==',key_name='tempest-keypair-1398730537',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:01:37.584110',shelved_host='user',shelved_image_id='b1bb403e-071d-4aac-9585-3a57cb9dea94'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG os_vif [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7201185-dc, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing instance network info cache due to event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:01:39 user nova-compute[71206]: INFO os_vif [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc')
Jul 27 18:01:39 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Deleting instance files /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9_del
Jul 27 18:01:39 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Deletion of /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9_del complete
Jul 27 18:01:39 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Deleted allocations for instance d1c93904-5854-4093-a782-58723eb98bb9
Jul 27 18:01:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.objects.instance [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'numa_topology' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updated VIF entry in instance network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa7201185-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-db5f4fa8-99d8-43a7-88dc-7886e3c8dea8 req-0a6b4980-28cc-43e3-b782-6ba638660670 service nova] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:01:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:01:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-82fc3ec2-f230-49cd-a3c6-a07903ca45f9 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.012s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connector [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Factory for ISCSI on None {{(pid=71206) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXBYLerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:44 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:01:44 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:01:44 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80601d-399b-4660-8bd6-00982368eba9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:01:44 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f2fd2-fd08-43c3-a1d4-f9041194ff8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57] added
Jul 27 18:01:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb882e8-4920-4d90-b203-9105737cdb29]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[247d0e7d-6234-4f32-a022-23307b67663c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXBYLerP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXBYLerP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21bc759-a075-45d1-93ea-f188a7c33db1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXBYLerP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aaaf75-e331-460d-9c72-38d074f9ba65]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4641ee9-2e0c-410e-9323-f6eb3b03e902]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:01:44 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:01:44 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:01:44 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:01:44 user nova-compute[71206]: 
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe11a1-7c0d-4d5e-abe7-cacc4b7912f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260]
Jul 27 18:01:44 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260] successful.
Jul 27 18:01:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04905556-4ab1-475a-96ed-39d186ecd372]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b5e5c-ee94-45f4-b11e-d8a592d853ef]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)
Jul 27 18:01:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)
Jul 27 18:01:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19760a6b-937a-4fe4-9ab1-e8559120d1f3]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:01:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXBYLerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26361393135386638', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361393135386638', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lazy-loading 'flavor' on Instance uuid eab112a5-6c8d-4d54-86f9-15e28491d037 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:01:45 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:01:45 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:01:45 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:01:45 user nova-compute[71206]:   <serial>224257fc-e5ca-43a0-92a9-3e17f12b1a57</serial>
Jul 27 18:01:45 user nova-compute[71206]: </disk>
Jul 27 18:01:45 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] No VIF found with MAC fa:16:3e:c8:e1:6d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-acb0b9ed-fa06-4cdc-b186-1e7d00b490b8 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.117s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:46 user nova-compute[71206]: INFO nova.compute.manager [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Terminating instance
Jul 27 18:01:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-unplugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] No waiting events found dispatching network-vif-unplugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2000551-d5a2-4127-9304-3aa8b718bfd8 req-a279b5fc-36e2-4901-b756-76fd117f3426 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-unplugged-9e2205c9-1194-427b-829f-8103572bff88 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:01:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Instance destroyed successfully.
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.objects.instance [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lazy-loading 'resources' on Instance uuid eab112a5-6c8d-4d54-86f9-15e28491d037 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-102117359',display_name='tempest-DeleteServersTestJSON-server-102117359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-102117359',id=4,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed96b96d9354c78ad378575a68b98a8',ramdisk_id='',reservation_id='r-961qnf0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1742407945',owner_user_name='tempest-DeleteServersTestJSON-1742407945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:59:59Z,user_data=None,user_id='11517efe2d6c4446a70ebee263053835',uuid=eab112a5-6c8d-4d54-86f9-15e28491d037,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converting VIF {"id": "9e2205c9-1194-427b-829f-8103572bff88", "address": "fa:16:3e:c8:e1:6d", "network": {"id": "129588a7-49f2-4f5f-abc6-0520c04f1a85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454359759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed96b96d9354c78ad378575a68b98a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e2205c9-11", "ovs_interfaceid": "9e2205c9-1194-427b-829f-8103572bff88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_vif [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e2205c9-11, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:47 user nova-compute[71206]: INFO os_vif [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e1:6d,bridge_name='br-int',has_traffic_filtering=True,id=9e2205c9-1194-427b-829f-8103572bff88,network=Network(129588a7-49f2-4f5f-abc6-0520c04f1a85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e2205c9-11')
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXBYLerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf3330-9af5-40a0-9872-4636a85bb157]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:01:47 user nova-compute[71206]: No targets found.
Jul 27 18:01:47 user nova-compute[71206]: iSNS:
Jul 27 18:01:47 user nova-compute[71206]: No targets found.
Jul 27 18:01:47 user nova-compute[71206]: STATIC:
Jul 27 18:01:47 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57
Jul 27 18:01:47 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:01:47 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:01:47 user nova-compute[71206]: FIRMWARE:
Jul 27 18:01:47 user nova-compute[71206]: No targets found.
Jul 27 18:01:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:01:47 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:01:47 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347f619-e131-434e-b87a-26a759554574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0dcd8f-5bc1-4232-8738-3ddbff42c5a3]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)
Jul 27 18:01:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 (non-flash)
Jul 27 18:01:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e243565f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd3b990-e747-4a2a-90d9-8ed5cfb60aa6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257bdb1-7a75-447a-a944-b3148016e145]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d51c1-af1b-4c52-aa03-11dd41810f2d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536c871-7e26-4ba0-aee1-2259de0b7425]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb02d5-a77e-46ea-9eeb-6dcbf68f62ee]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fec3da-1cc2-45f4-b87e-9b021faa1f9d]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260]
Jul 27 18:01:47 user nova-compute[71206]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57, portal: 172.16.0.220,3260] successful.
Jul 27 18:01:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224257fc-e5ca-43a0-92a9-3e17f12b1a57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c571ca5-163b-4396-a035-13d1c83003e9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] <== disconnect_volume: return (314ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:01:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Deleting instance files /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037_del
Jul 27 18:01:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Deletion of /opt/stack/data/nova/instances/eab112a5-6c8d-4d54-86f9-15e28491d037_del complete
Jul 27 18:01:48 user nova-compute[71206]: INFO nova.compute.manager [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 27 18:01:48 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-2d016e88-4463-41ce-b5f2-6581cb1c3001 req-1c4b3c94-1c26-4380-97ff-1f348129e448 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-deleted-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:48 user nova-compute[71206]: INFO nova.compute.manager [req-2d016e88-4463-41ce-b5f2-6581cb1c3001 req-1c4b3c94-1c26-4380-97ff-1f348129e448 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Neutron deleted interface 9e2205c9-1194-427b-829f-8103572bff88; detaching it from the instance and deleting it from the info cache
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-2d016e88-4463-41ce-b5f2-6581cb1c3001 req-1c4b3c94-1c26-4380-97ff-1f348129e448 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:48 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Took 0.59 seconds to deallocate network for instance.
Jul 27 18:01:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-2d016e88-4463-41ce-b5f2-6581cb1c3001 req-1c4b3c94-1c26-4380-97ff-1f348129e448 service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Detach interface failed, port_id=9e2205c9-1194-427b-829f-8103572bff88, reason: Instance eab112a5-6c8d-4d54-86f9-15e28491d037 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690480894.0674558, d1c93904-5854-4093-a782-58723eb98bb9 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:01:49 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Stopped (Lifecycle Event)
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e9a987f4-d4c0-401e-8657-d9627322f7c6 None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] Acquiring lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] No waiting events found dispatching network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:49 user nova-compute[71206]: WARNING nova.compute.manager [req-249b959a-5e77-4c56-ab2b-f99800f7c825 req-0ac1f8b2-09e5-4535-8748-2859e314ad1c service nova] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Received unexpected event network-vif-plugged-9e2205c9-1194-427b-829f-8103572bff88 for instance with vm_state active and task_state deleting.
Jul 27 18:01:49 user nova-compute[71206]: INFO nova.compute.manager [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Took 0.76 seconds to detach 1 volumes for instance.
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:01:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:49 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Deleted allocations for instance eab112a5-6c8d-4d54-86f9-15e28491d037
Jul 27 18:01:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70c266cc-e02e-48e8-a4d7-fd4214a12004 tempest-DeleteServersTestJSON-1742407945 tempest-DeleteServersTestJSON-1742407945-project-member] Lock "eab112a5-6c8d-4d54-86f9-15e28491d037" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.318s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-changed-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Refreshing instance network info cache due to event network-changed-f3a08c29-ae46-4a09-936a-142747a0b0e7. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] Acquiring lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] Acquired lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Refreshing network info cache for port f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-changed-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing instance network info cache due to event network-changed-2846403b-4b4b-45d6-913f-aca6ec36385e. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing network info cache for port 2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updated VIF entry in instance network info cache for port f3a08c29-ae46-4a09-936a-142747a0b0e7. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updating instance_info_cache with network_info: [{"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fe800bc6-b690-46e3-9997-62daeb8eda08 req-22377567-7c9b-4e79-b7d0-f8aee180a4a5 service nova] Releasing lock "refresh_cache-80b19738-1683-4af2-a706-4ec8d9fd24e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updated VIF entry in instance network info cache for port 2846403b-4b4b-45d6-913f-aca6ec36385e. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b2dd0f1-38b8-42a5-956e-b218fc1ba335 req-65a7a3a2-ef90-4e13-82dc-e3c6123d05c1 service nova] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'pci_requests' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG nova.policy [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '411afe8aa87048debd9703a1b141eb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679da984d9634ff18a2af5f57475a990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:01:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Successfully created port: 26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:01:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Successfully updated port: 26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-changed-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing instance network info cache due to event network-changed-26ce03e4-9476-4d88-94d5-da753e5e82ef. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Refreshing network info cache for port 26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG os_vif [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26ce03e4-94, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26ce03e4-94, col_values=(('external_ids', {'iface-id': '26ce03e4-9476-4d88-94d5-da753e5e82ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ab:21', 'vm-uuid': '94791cd9-cfbb-4d07-82f0-3cbfaaacbf13'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: INFO os_vif [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94')
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] attach device xml: <interface type="ethernet">
Jul 27 18:01:54 user nova-compute[71206]:   <mac address="fa:16:3e:7a:ab:21"/>
Jul 27 18:01:54 user nova-compute[71206]:   <model type="virtio"/>
Jul 27 18:01:54 user nova-compute[71206]:   <mtu size="1442"/>
Jul 27 18:01:54 user nova-compute[71206]:   <target dev="tap26ce03e4-94"/>
Jul 27 18:01:54 user nova-compute[71206]: </interface>
Jul 27 18:01:54 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'flavor' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:55 user nova-compute[71206]: WARNING nova.compute.manager [req-e2222d66-dace-403b-8f40-a28e961c4c6b req-42e878f8-44c4-4976-a0f9-0c7d9b993ff7 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef for instance with vm_state active and task_state None.
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No VIF found with MAC fa:16:3e:57:be:a8, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:01:55 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:01:55</nova:creationTime>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:01:55 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:01:55 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:owner>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:01:55 user nova-compute[71206]:   </nova:owner>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:01:55 user nova-compute[71206]:   <nova:ports>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:01:55 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:01:55 user nova-compute[71206]:     </nova:port>
Jul 27 18:01:55 user nova-compute[71206]:     <nova:port uuid="26ce03e4-9476-4d88-94d5-da753e5e82ef">
Jul 27 18:01:55 user nova-compute[71206]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Jul 27 18:01:55 user nova-compute[71206]:     </nova:port>
Jul 27 18:01:55 user nova-compute[71206]:   </nova:ports>
Jul 27 18:01:55 user nova-compute[71206]: </nova:instance>
Jul 27 18:01:55 user nova-compute[71206]:  {{(pid=71206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updated VIF entry in instance network info cache for port 26ce03e4-9476-4d88-94d5-da753e5e82ef. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3b1d3978-6e3b-409a-ad04-bd7c25dcf0a1 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.134s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-22bf54f8-a86c-4d14-97ba-67a9391f4f49 req-8f5a85a5-5fb5-49f9-8988-57706a417005 service nova] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:55 user nova-compute[71206]: INFO nova.compute.manager [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Attaching volume 86c3a651-e902-434b-aacd-87a3fb497bde to /dev/vdb
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.utils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2927ca-d0aa-4ee2-b726-8dbe8dea38d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[723aab65-c109-4726-8ce6-e9925be28d37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f722861-f1a9-45e9-b040-96659bd01dc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0c38e-a65b-4a25-9eb4-47da35321191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:55 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45092c48-d746-4579-ab12-2b4a5071183b]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.utils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updating existing volume attachment record: 05b97907-31ae-4fd6-8767-9ffabcf501c5 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:55 user nova-compute[71206]: INFO nova.compute.manager [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Attaching volume fef3c731-30d6-42d9-99b5-1e2f185c0720 to /dev/vdb
Jul 27 18:01:55 user nova-compute[71206]: DEBUG os_brick.utils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb61c12a-d485-40ba-9d0c-6725f23b8fca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e3b67-82ac-41b6-8050-48f2260fd726]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0f20c6-4e5c-4aa5-85b9-ba5c67467c20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebcb8c-59c2-43c9-affd-b9949f7d208a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:56 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:01:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd5c37-37e8-4768-a84f-d492e51193bd]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:56 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating existing volume attachment record: 6de11e6b-8582-42fb-a585-f242dd528511 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-changed-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Refreshing instance network info cache due to event network-changed-107fcac0-825a-4a40-a7fa-c5a1ae4a5965. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] Acquiring lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] Acquired lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Refreshing network info cache for port 107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:01:57 user nova-compute[71206]: WARNING nova.compute.manager [req-f8062714-b842-4658-bfb6-942551323ab9 req-262f7bb1-6232-423e-996c-f3a9250f987e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef for instance with vm_state active and task_state None.
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'flavor' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updated VIF entry in instance network info cache for port 107fcac0-825a-4a40-a7fa-c5a1ae4a5965. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating instance_info_cache with network_info: [{"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2d3a1e7-1e34-4375-bd9f-f446fc6e3a9e req-07ce8e81-ed13-4540-905e-fbc7c3054637 service nova] Releasing lock "refresh_cache-24390c1b-61e1-4a56-92ae-cd7b79e67da6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:01:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:01:57 user nova-compute[71206]: INFO nova.compute.manager [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attaching volume 73cb326f-4e7a-4eb9-a845-515577a00945 to /dev/vdb
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.utils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f9ee6-15c4-4ad6-87e8-b856f0c0a467]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964e56b-92c3-4486-a7e8-d8c595a87ced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df78be8-2060-46bd-a157-01303dedcd3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf64c9-9068-4917-ab82-2282be78cc5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:01:58 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:01:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db5c40-3c96-46d3-ad74-15f1a5884b92]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG os_brick.utils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:01:58 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating existing volume attachment record: 3a87356a-447c-493b-afe3-e7c86c812219 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:01:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvjoakYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:02 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:02 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:02 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690480907.5410488, eab112a5-6c8d-4d54-86f9-15e28491d037 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:02 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] VM Stopped (Lifecycle Event)
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6ab9c-31da-4c4d-b0be-e1c973d21839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:02 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-60c3d9e0-1b03-4c71-9d85-8080469c1108 None None] [instance: eab112a5-6c8d-4d54-86f9-15e28491d037] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208d619-b46e-40c8-ba7a-ef18c302d415]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde] added
Jul 27 18:02:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9614320-91b2-41c8-8617-9380ddc0003b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54be33-a314-4a49-bf49-92f94277c407]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvjoakYw {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvjoakYw" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb0b14-162d-4be5-a1d8-6ea005318b23]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rvjoakYw'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba24b4-4f08-40a3-82ff-ba0cb05048ae]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[70053adb-d304-47d5-9419-a8d470c1508b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:02:02 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:02:02 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:02 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:02:02 user nova-compute[71206]: 
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6051f877-dac5-4201-aa72-10cc736c501f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260]
Jul 27 18:02:02 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a33d59-bbc8-45b9-ba5e-69d899ea3cc3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dada6397-c65d-44bf-b6ff-3a8efb57657f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[795de2d3-afc8-4864-b725-99a88baff544]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQIaZWVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvjoakYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26365313261393863', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365313261393863', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.633s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:03 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'flavor' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb846c4a-17b7-469d-a95a-caca80d543c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:03 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:02:03 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:03 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:03 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:03 user nova-compute[71206]:   <serial>86c3a651-e902-434b-aacd-87a3fb497bde</serial>
Jul 27 18:02:03 user nova-compute[71206]: </disk>
Jul 27 18:02:03 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a01c8-a73e-428f-8f13-d69388f4266f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720] added
Jul 27 18:02:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[808a1986-9cfb-473d-8657-c5353e5f4403]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34948e18-2760-4a26-bba6-c75f4e3e97d5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQIaZWVk {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQIaZWVk" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad6111-74e7-47d4-9b6a-1d5b7bb5115f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQIaZWVk'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece40327-cd7f-4911-9d63-25c0fa75df03]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[535ce26c-9777-4cd9-b3b9-87ed2b4df2d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0c516-2090-422d-8dd1-691cb520b3fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260]
Jul 27 18:02:04 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3763b7d6-b478-4cd5-83d0-24c5b88016e8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-changed-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Refreshing instance network info cache due to event network-changed-56c61374-8bca-47a0-af37-41ee6e2ea991. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] Acquiring lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] Acquired lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Refreshing network info cache for port 56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[648e8127-5309-4c61-92ca-f5bbdc97afc7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:04 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:04 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea7245-6793-4705-9eee-1f0379aff6a5]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQIaZWVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No VIF found with MAC fa:16:3e:ab:2b:53, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8cdc57f7-3f6e-4213-b8ec-008d904837d6 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.195s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updated VIF entry in instance network info cache for port 56c61374-8bca-47a0-af37-41ee6e2ea991. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updating instance_info_cache with network_info: [{"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1e693f88-16c7-4cb0-af5e-9fa255403e2b req-f3d41a67-7c6f-4e36-9b36-b75df22b8828 service nova] Releasing lock "refresh_cache-de639534-60e8-4cd1-bcc8-92a29efd0610" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] <== connect_volume: return (1995ms) {'type': 'block', 'scsi_wwn': '23933336466636635', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933336466636635', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:02:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:05 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:02:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:05 user nova-compute[71206]:   <serial>fef3c731-30d6-42d9-99b5-1e2f185c0720</serial>
Jul 27 18:02:05 user nova-compute[71206]: </disk>
Jul 27 18:02:05 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] No VIF found with MAC fa:16:3e:57:be:a8, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:05 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:05 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:05 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb8afe2-c110-48dd-8dba-35b0b9a3506d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:05 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453edd5-0cfc-4f27-b14e-7b4843aee335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945] added
Jul 27 18:02:05 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007233d-8801-4e66-bcef-f4e0e53e49b7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5ff2ec98-a418-4ff2-aee9-78e2e4687cde tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.937s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7151200-4a23-4fda-8147-c26aa5515f5d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: INFO nova.compute.manager [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Detaching volume 86c3a651-e902-434b-aacd-87a3fb497bde
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqDSLalO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqDSLalO" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62074f4e-f2da-4bb9-a223-86c42653ab63]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YqDSLalO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd738b-debb-4c9a-97d8-f3f8a00d9b55]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: INFO nova.virt.block_device [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Attempting to driver detach volume 86c3a651-e902-434b-aacd-87a3fb497bde from mountpoint /dev/vdb
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4cd641-f0b8-49d3-8189-e3a84f266557]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:05 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:05 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:05 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:05 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Attempting to detach device vdb from instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:05 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:05 user nova-compute[71206]:   <serial>86c3a651-e902-434b-aacd-87a3fb497bde</serial>
Jul 27 18:02:05 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:02:05 user nova-compute[71206]: </disk>
Jul 27 18:02:05 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully detached device vdb from instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 from the persistent domain config.
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:05 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:05 user nova-compute[71206]:   <serial>86c3a651-e902-434b-aacd-87a3fb497bde</serial>
Jul 27 18:02:05 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:02:05 user nova-compute[71206]: </disk>
Jul 27 18:02:05 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab53d84-2865-4b34-9079-029ec43647ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]
Jul 27 18:02:05 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:05 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc0d9e-273d-40e1-80ad-1f720fb6030c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410fbac-6864-49b9-9325-e4e81a3418fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:06 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:06 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:06 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:06 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db473ae3-f71e-4ad0-b744-ce5c0b23cc7a]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690480926.4231658, 80b19738-1683-4af2-a706-4ec8d9fd24e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:02:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully detached device vdb from instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 from the live domain config.
Jul 27 18:02:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvjoakYw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:06 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:06 user nova-compute[71206]: INFO nova.compute.manager [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Detaching volume fef3c731-30d6-42d9-99b5-1e2f185c0720
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26562643034633336', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562643034633336', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:07 user nova-compute[71206]: INFO nova.virt.block_device [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Attempting to driver detach volume fef3c731-30d6-42d9-99b5-1e2f185c0720 from mountpoint /dev/vdb
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.622s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'flavor' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Attempting to detach device vdb from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:07 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:07 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:02:07 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:07 user nova-compute[71206]:   <serial>fef3c731-30d6-42d9-99b5-1e2f185c0720</serial>
Jul 27 18:02:07 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:02:07 user nova-compute[71206]: </disk>
Jul 27 18:02:07 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd1614-ad02-4ea9-947f-16201e278e90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]: iSNS:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]: STATIC:
Jul 27 18:02:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720
Jul 27 18:02:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde
Jul 27 18:02:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:07 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:07 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:07 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully detached device vdb from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the persistent domain config.
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:07 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:07 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:02:07 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:07 user nova-compute[71206]:   <serial>fef3c731-30d6-42d9-99b5-1e2f185c0720</serial>
Jul 27 18:02:07 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:02:07 user nova-compute[71206]: </disk>
Jul 27 18:02:07 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc85137-f9ef-41d1-abbf-3a469fb36a8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:02:07 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:07 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:02:07 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:07 user nova-compute[71206]:   <serial>73cb326f-4e7a-4eb9-a845-515577a00945</serial>
Jul 27 18:02:07 user nova-compute[71206]: </disk>
Jul 27 18:02:07 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44decb9f-c845-4d05-8d9e-d909e0b1ce2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24355510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3d3e4-c515-438b-9f0a-5cbaf9d55b37]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2f091-b8d2-4f5b-97fd-33fda402e0f1]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63ba23-107a-4de0-90c6-b01e0d261a29]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd0e66-6d03-436f-8f25-7893b3f9d243]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64da819-0fcf-4212-b822-c8cf317509c3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f18d8-0efd-461a-b0ed-0bc40cbc2149]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260]
Jul 27 18:02:07 user nova-compute[71206]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86c3a651-e902-434b-aacd-87a3fb497bde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225e1a1-dd69-416d-a91d-e6f61eb28152]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] <== disconnect_volume: return (930ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] No VIF found with MAC fa:16:3e:b4:ea:41, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b171d5f-39db-4b1f-b9f4-db64090149d4 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.818s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690480927.7634237, 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:02:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully detached device vdb from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the live domain config.
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQIaZWVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:07 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d40de-a8d2-41c5-94d4-1c795125bad5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]: iSNS:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]: STATIC:
Jul 27 18:02:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720
Jul 27 18:02:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:07 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:07 user nova-compute[71206]: No targets found.
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:07 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:07 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7a09b0-d389-4175-a23f-c5934e1e5d4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99914c58-2df8-4ae3-8622-9a153f97360b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e241abb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30314710-e422-40e6-8746-0c768cd4efa1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cff170-86b4-4005-9490-fac40ed27c4f]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'flavor' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd3d97-39e6-4ba7-8a3f-012032349b0f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21624874-eeeb-439f-8fed-aa07231cafe1]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dcbc69-3599-4bda-836f-1567527adf85]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac79c7-16c7-422c-8851-52b06c28659a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260]
Jul 27 18:02:08 user nova-compute[71206]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:08 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef3c731-30d6-42d9-99b5-1e2f185c0720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57bc19-9f9e-412d-90e1-dcfa0d0fb148]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] <== disconnect_volume: return (320ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:08 user nova-compute[71206]: INFO nova.compute.manager [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Attaching volume 37a369b3-ae90-437c-abba-562c74b8e496 to /dev/sdc
Jul 27 18:02:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'flavor' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-da2461e6-5d2b-4e42-b5fd-84389255ffe2 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.432s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.utils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc71770-ef8b-4d9f-93db-dc72d73b6a08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5705cb89-511c-4d1a-98b3-7d1c861e1a1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33da5d-fa0f-44d6-a607-1a7021d9d27e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c511a9-8825-4faa-bf4a-b10e906c33f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:08 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ed0c3-0e08-4d59-994b-2bbadc889490]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.utils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updating existing volume attachment record: a7ede2b3-27bc-4fae-b2da-d5d34f15ec07 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.utils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[267534d5-bdbc-4c86-9b2b-d1e4b7e40f2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e0f74-1846-4f21-af26-f8e51edd33de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad2d8d2-e2fd-4c67-a57d-a037795aa408]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b8d02-b4ff-4cee-87a0-b44844b11575]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:08 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:02:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1476ddb-73ff-481d-b356-0f236479dc9c]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:02:08 user nova-compute[71206]: DEBUG os_brick.utils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:08 user nova-compute[71206]: INFO nova.compute.manager [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Swapping volume 73cb326f-4e7a-4eb9-a845-515577a00945 for 42476c2a-8f61-4ec8-a4f6-6339cc9ebe02
Jul 27 18:02:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ca7ac0ad-0925-4ca0-b938-43b1eaaff329 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.060s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-26ce03e4-9476-4d88-94d5-da753e5e82ef" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-26ce03e4-9476-4d88-94d5-da753e5e82ef" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Attempting to detach device tap26ce03e4-94 from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] detach device xml: <interface type="ethernet">
Jul 27 18:02:09 user nova-compute[71206]:   <mac address="fa:16:3e:7a:ab:21"/>
Jul 27 18:02:09 user nova-compute[71206]:   <model type="virtio"/>
Jul 27 18:02:09 user nova-compute[71206]:   <mtu size="1442"/>
Jul 27 18:02:09 user nova-compute[71206]:   <target dev="tap26ce03e4-94"/>
Jul 27 18:02:09 user nova-compute[71206]: </interface>
Jul 27 18:02:09 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 18:02:09 user nova-compute[71206]:   <name>instance-00000009</name>
Jul 27 18:02:09 user nova-compute[71206]:   <uuid>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</uuid>
Jul 27 18:02:09 user nova-compute[71206]:   <metadata>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:09 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:01:55</nova:creationTime>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:09 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:09 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:09 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:port uuid="26ce03e4-9476-4d88-94d5-da753e5e82ef">
Jul 27 18:02:09 user nova-compute[71206]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Jul 27 18:02:09 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:09 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:09 user nova-compute[71206]:   </metadata>
Jul 27 18:02:09 user nova-compute[71206]:   <memory unit='KiB'>524288</memory>
Jul 27 18:02:09 user nova-compute[71206]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 18:02:09 user nova-compute[71206]:   <vcpu placement='static'>1</vcpu>
Jul 27 18:02:09 user nova-compute[71206]:   <resource>
Jul 27 18:02:09 user nova-compute[71206]:     <partition>/machine</partition>
Jul 27 18:02:09 user nova-compute[71206]:   </resource>
Jul 27 18:02:09 user nova-compute[71206]:   <sysinfo type='smbios'>
Jul 27 18:02:09 user nova-compute[71206]:     <system>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='version'>0.0.0</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='serial'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='uuid'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='family'>Virtual Machine</entry>
Jul 27 18:02:09 user nova-compute[71206]:     </system>
Jul 27 18:02:09 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:09 user nova-compute[71206]:   <os>
Jul 27 18:02:09 user nova-compute[71206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 18:02:09 user nova-compute[71206]:     <boot dev='hd'/>
Jul 27 18:02:09 user nova-compute[71206]:     <smbios mode='sysinfo'/>
Jul 27 18:02:09 user nova-compute[71206]:   </os>
Jul 27 18:02:09 user nova-compute[71206]:   <features>
Jul 27 18:02:09 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:09 user nova-compute[71206]:     <apic/>
Jul 27 18:02:09 user nova-compute[71206]:     <vmcoreinfo state='on'/>
Jul 27 18:02:09 user nova-compute[71206]:   </features>
Jul 27 18:02:09 user nova-compute[71206]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 18:02:09 user nova-compute[71206]:     <model fallback='forbid'>Nehalem</model>
Jul 27 18:02:09 user nova-compute[71206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='vme'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='x2apic'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='hypervisor'/>
Jul 27 18:02:09 user nova-compute[71206]:   </cpu>
Jul 27 18:02:09 user nova-compute[71206]:   <clock offset='utc'>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='hpet' present='no'/>
Jul 27 18:02:09 user nova-compute[71206]:   </clock>
Jul 27 18:02:09 user nova-compute[71206]:   <on_poweroff>destroy</on_poweroff>
Jul 27 18:02:09 user nova-compute[71206]:   <on_reboot>restart</on_reboot>
Jul 27 18:02:09 user nova-compute[71206]:   <on_crash>destroy</on_crash>
Jul 27 18:02:09 user nova-compute[71206]:   <devices>
Jul 27 18:02:09 user nova-compute[71206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 18:02:09 user nova-compute[71206]:     <disk type='file' device='disk'>
Jul 27 18:02:09 user nova-compute[71206]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 18:02:09 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk' index='2'/>
Jul 27 18:02:09 user nova-compute[71206]:       <backingStore type='file' index='3'>
Jul 27 18:02:09 user nova-compute[71206]:         <format type='raw'/>
Jul 27 18:02:09 user nova-compute[71206]:         <source file='/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1'/>
Jul 27 18:02:09 user nova-compute[71206]:         <backingStore/>
Jul 27 18:02:09 user nova-compute[71206]:       </backingStore>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='vda' bus='virtio'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='virtio-disk0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </disk>
Jul 27 18:02:09 user nova-compute[71206]:     <disk type='file' device='cdrom'>
Jul 27 18:02:09 user nova-compute[71206]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 18:02:09 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config' index='1'/>
Jul 27 18:02:09 user nova-compute[71206]:       <backingStore/>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='hda' bus='ide'/>
Jul 27 18:02:09 user nova-compute[71206]:       <readonly/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='ide0-0-0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </disk>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='usb' index='0' model='none'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='usb'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='pci.0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='ide' index='0'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='ide'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <interface type='ethernet'>
Jul 27 18:02:09 user nova-compute[71206]:       <mac address='fa:16:3e:57:be:a8'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='tap2846403b-4b'/>
Jul 27 18:02:09 user nova-compute[71206]:       <model type='virtio'/>
Jul 27 18:02:09 user nova-compute[71206]:       <mtu size='1442'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='net0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </interface>
Jul 27 18:02:09 user nova-compute[71206]:     <interface type='ethernet'>
Jul 27 18:02:09 user nova-compute[71206]:       <mac address='fa:16:3e:7a:ab:21'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='tap26ce03e4-94'/>
Jul 27 18:02:09 user nova-compute[71206]:       <model type='virtio'/>
Jul 27 18:02:09 user nova-compute[71206]:       <mtu size='1442'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='net1'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </interface>
Jul 27 18:02:09 user nova-compute[71206]:     <serial type='pty'>
Jul 27 18:02:09 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:09 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target type='isa-serial' port='0'>
Jul 27 18:02:09 user nova-compute[71206]:         <model name='isa-serial'/>
Jul 27 18:02:09 user nova-compute[71206]:       </target>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </serial>
Jul 27 18:02:09 user nova-compute[71206]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 18:02:09 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:09 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target type='serial' port='0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </console>
Jul 27 18:02:09 user nova-compute[71206]:     <input type='mouse' bus='ps2'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='input0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </input>
Jul 27 18:02:09 user nova-compute[71206]:     <input type='keyboard' bus='ps2'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='input1'/>
Jul 27 18:02:09 user nova-compute[71206]:     </input>
Jul 27 18:02:09 user nova-compute[71206]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 18:02:09 user nova-compute[71206]:       <listen type='address' address='0.0.0.0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </graphics>
Jul 27 18:02:09 user nova-compute[71206]:     <audio id='1' type='none'/>
Jul 27 18:02:09 user nova-compute[71206]:     <video>
Jul 27 18:02:09 user nova-compute[71206]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='video0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </video>
Jul 27 18:02:09 user nova-compute[71206]:     <memballoon model='virtio'>
Jul 27 18:02:09 user nova-compute[71206]:       <stats period='10'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='balloon0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:09 user nova-compute[71206]:     <rng model='virtio'>
Jul 27 18:02:09 user nova-compute[71206]:       <backend model='random'>/dev/urandom</backend>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='rng0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </rng>
Jul 27 18:02:09 user nova-compute[71206]:   </devices>
Jul 27 18:02:09 user nova-compute[71206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 18:02:09 user nova-compute[71206]:     <label>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</label>
Jul 27 18:02:09 user nova-compute[71206]:     <imagelabel>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</imagelabel>
Jul 27 18:02:09 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:09 user nova-compute[71206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 18:02:09 user nova-compute[71206]:     <label>+64055:+108</label>
Jul 27 18:02:09 user nova-compute[71206]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 18:02:09 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:09 user nova-compute[71206]: </domain>
Jul 27 18:02:09 user nova-compute[71206]:  {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 18:02:09 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully detached device tap26ce03e4-94 from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the persistent domain config.
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] (1/8): Attempting to detach device tap26ce03e4-94 with device alias net1 from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] detach device xml: <interface type="ethernet">
Jul 27 18:02:09 user nova-compute[71206]:   <mac address="fa:16:3e:7a:ab:21"/>
Jul 27 18:02:09 user nova-compute[71206]:   <model type="virtio"/>
Jul 27 18:02:09 user nova-compute[71206]:   <mtu size="1442"/>
Jul 27 18:02:09 user nova-compute[71206]:   <target dev="tap26ce03e4-94"/>
Jul 27 18:02:09 user nova-compute[71206]: </interface>
Jul 27 18:02:09 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690480929.524291, 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Start waiting for the detach event from libvirt for device tap26ce03e4-94 with device alias net1 for instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 18:02:09 user nova-compute[71206]:   <name>instance-00000009</name>
Jul 27 18:02:09 user nova-compute[71206]:   <uuid>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</uuid>
Jul 27 18:02:09 user nova-compute[71206]:   <metadata>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:09 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:01:55</nova:creationTime>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:09 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:09 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:09 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:port uuid="26ce03e4-9476-4d88-94d5-da753e5e82ef">
Jul 27 18:02:09 user nova-compute[71206]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Jul 27 18:02:09 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:09 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:09 user nova-compute[71206]:   </metadata>
Jul 27 18:02:09 user nova-compute[71206]:   <memory unit='KiB'>524288</memory>
Jul 27 18:02:09 user nova-compute[71206]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 18:02:09 user nova-compute[71206]:   <vcpu placement='static'>1</vcpu>
Jul 27 18:02:09 user nova-compute[71206]:   <resource>
Jul 27 18:02:09 user nova-compute[71206]:     <partition>/machine</partition>
Jul 27 18:02:09 user nova-compute[71206]:   </resource>
Jul 27 18:02:09 user nova-compute[71206]:   <sysinfo type='smbios'>
Jul 27 18:02:09 user nova-compute[71206]:     <system>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='version'>0.0.0</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='serial'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='uuid'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:09 user nova-compute[71206]:       <entry name='family'>Virtual Machine</entry>
Jul 27 18:02:09 user nova-compute[71206]:     </system>
Jul 27 18:02:09 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:09 user nova-compute[71206]:   <os>
Jul 27 18:02:09 user nova-compute[71206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 18:02:09 user nova-compute[71206]:     <boot dev='hd'/>
Jul 27 18:02:09 user nova-compute[71206]:     <smbios mode='sysinfo'/>
Jul 27 18:02:09 user nova-compute[71206]:   </os>
Jul 27 18:02:09 user nova-compute[71206]:   <features>
Jul 27 18:02:09 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:09 user nova-compute[71206]:     <apic/>
Jul 27 18:02:09 user nova-compute[71206]:     <vmcoreinfo state='on'/>
Jul 27 18:02:09 user nova-compute[71206]:   </features>
Jul 27 18:02:09 user nova-compute[71206]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 18:02:09 user nova-compute[71206]:     <model fallback='forbid'>Nehalem</model>
Jul 27 18:02:09 user nova-compute[71206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='vme'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='x2apic'/>
Jul 27 18:02:09 user nova-compute[71206]:     <feature policy='require' name='hypervisor'/>
Jul 27 18:02:09 user nova-compute[71206]:   </cpu>
Jul 27 18:02:09 user nova-compute[71206]:   <clock offset='utc'>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 18:02:09 user nova-compute[71206]:     <timer name='hpet' present='no'/>
Jul 27 18:02:09 user nova-compute[71206]:   </clock>
Jul 27 18:02:09 user nova-compute[71206]:   <on_poweroff>destroy</on_poweroff>
Jul 27 18:02:09 user nova-compute[71206]:   <on_reboot>restart</on_reboot>
Jul 27 18:02:09 user nova-compute[71206]:   <on_crash>destroy</on_crash>
Jul 27 18:02:09 user nova-compute[71206]:   <devices>
Jul 27 18:02:09 user nova-compute[71206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 18:02:09 user nova-compute[71206]:     <disk type='file' device='disk'>
Jul 27 18:02:09 user nova-compute[71206]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 18:02:09 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk' index='2'/>
Jul 27 18:02:09 user nova-compute[71206]:       <backingStore type='file' index='3'>
Jul 27 18:02:09 user nova-compute[71206]:         <format type='raw'/>
Jul 27 18:02:09 user nova-compute[71206]:         <source file='/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1'/>
Jul 27 18:02:09 user nova-compute[71206]:         <backingStore/>
Jul 27 18:02:09 user nova-compute[71206]:       </backingStore>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='vda' bus='virtio'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='virtio-disk0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </disk>
Jul 27 18:02:09 user nova-compute[71206]:     <disk type='file' device='cdrom'>
Jul 27 18:02:09 user nova-compute[71206]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 18:02:09 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config' index='1'/>
Jul 27 18:02:09 user nova-compute[71206]:       <backingStore/>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='hda' bus='ide'/>
Jul 27 18:02:09 user nova-compute[71206]:       <readonly/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='ide0-0-0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </disk>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='usb' index='0' model='none'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='usb'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='pci.0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <controller type='ide' index='0'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='ide'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 18:02:09 user nova-compute[71206]:     </controller>
Jul 27 18:02:09 user nova-compute[71206]:     <interface type='ethernet'>
Jul 27 18:02:09 user nova-compute[71206]:       <mac address='fa:16:3e:57:be:a8'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target dev='tap2846403b-4b'/>
Jul 27 18:02:09 user nova-compute[71206]:       <model type='virtio'/>
Jul 27 18:02:09 user nova-compute[71206]:       <mtu size='1442'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='net0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </interface>
Jul 27 18:02:09 user nova-compute[71206]:     <serial type='pty'>
Jul 27 18:02:09 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:09 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target type='isa-serial' port='0'>
Jul 27 18:02:09 user nova-compute[71206]:         <model name='isa-serial'/>
Jul 27 18:02:09 user nova-compute[71206]:       </target>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </serial>
Jul 27 18:02:09 user nova-compute[71206]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 18:02:09 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:09 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:09 user nova-compute[71206]:       <target type='serial' port='0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </console>
Jul 27 18:02:09 user nova-compute[71206]:     <input type='mouse' bus='ps2'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='input0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </input>
Jul 27 18:02:09 user nova-compute[71206]:     <input type='keyboard' bus='ps2'>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='input1'/>
Jul 27 18:02:09 user nova-compute[71206]:     </input>
Jul 27 18:02:09 user nova-compute[71206]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 18:02:09 user nova-compute[71206]:       <listen type='address' address='0.0.0.0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </graphics>
Jul 27 18:02:09 user nova-compute[71206]:     <audio id='1' type='none'/>
Jul 27 18:02:09 user nova-compute[71206]:     <video>
Jul 27 18:02:09 user nova-compute[71206]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='video0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </video>
Jul 27 18:02:09 user nova-compute[71206]:     <memballoon model='virtio'>
Jul 27 18:02:09 user nova-compute[71206]:       <stats period='10'/>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='balloon0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:09 user nova-compute[71206]:     <rng model='virtio'>
Jul 27 18:02:09 user nova-compute[71206]:       <backend model='random'>/dev/urandom</backend>
Jul 27 18:02:09 user nova-compute[71206]:       <alias name='rng0'/>
Jul 27 18:02:09 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 18:02:09 user nova-compute[71206]:     </rng>
Jul 27 18:02:09 user nova-compute[71206]:   </devices>
Jul 27 18:02:09 user nova-compute[71206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 18:02:09 user nova-compute[71206]:     <label>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</label>
Jul 27 18:02:09 user nova-compute[71206]:     <imagelabel>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</imagelabel>
Jul 27 18:02:09 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:09 user nova-compute[71206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 18:02:09 user nova-compute[71206]:     <label>+64055:+108</label>
Jul 27 18:02:09 user nova-compute[71206]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 18:02:09 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:09 user nova-compute[71206]: </domain>
Jul 27 18:02:09 user nova-compute[71206]:  {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 18:02:09 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully detached device tap26ce03e4-94 from instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 from the live domain config.
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG os_vif [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26ce03e4-94, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:09 user nova-compute[71206]: INFO os_vif [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94')
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:09 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:02:09</nova:creationTime>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:09 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:09 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:09 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:09 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:09 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:09 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:09 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:09 user nova-compute[71206]:  {{(pid=71206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-unplugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-unplugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:09 user nova-compute[71206]: WARNING nova.compute.manager [req-953ebe36-defb-446b-9f36-3903dbbe5251 req-0a1b813a-5bb2-45eb-ae9b-09bd049a6b70 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-unplugged-26ce03e4-9476-4d88-94d5-da753e5e82ef for instance with vm_state active and task_state None.
Jul 27 18:02:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-deleted-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:10 user nova-compute[71206]: INFO nova.compute.manager [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Neutron deleted interface 26ce03e4-9476-4d88-94d5-da753e5e82ef; detaching it from the instance and deleting it from the info cache
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquired lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.objects.instance [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Lazy-loading 'system_metadata' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.objects.instance [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Lazy-loading 'flavor' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 18:02:10 user nova-compute[71206]:   <name>instance-00000009</name>
Jul 27 18:02:10 user nova-compute[71206]:   <uuid>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</uuid>
Jul 27 18:02:10 user nova-compute[71206]:   <metadata>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:10 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:02:09</nova:creationTime>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:10 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:10 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:10 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:10 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:10 user nova-compute[71206]:   </metadata>
Jul 27 18:02:10 user nova-compute[71206]:   <memory unit='KiB'>524288</memory>
Jul 27 18:02:10 user nova-compute[71206]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 18:02:10 user nova-compute[71206]:   <vcpu placement='static'>1</vcpu>
Jul 27 18:02:10 user nova-compute[71206]:   <resource>
Jul 27 18:02:10 user nova-compute[71206]:     <partition>/machine</partition>
Jul 27 18:02:10 user nova-compute[71206]:   </resource>
Jul 27 18:02:10 user nova-compute[71206]:   <sysinfo type='smbios'>
Jul 27 18:02:10 user nova-compute[71206]:     <system>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='version'>0.0.0</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='serial'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='uuid'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='family'>Virtual Machine</entry>
Jul 27 18:02:10 user nova-compute[71206]:     </system>
Jul 27 18:02:10 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:10 user nova-compute[71206]:   <os>
Jul 27 18:02:10 user nova-compute[71206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 18:02:10 user nova-compute[71206]:     <boot dev='hd'/>
Jul 27 18:02:10 user nova-compute[71206]:     <smbios mode='sysinfo'/>
Jul 27 18:02:10 user nova-compute[71206]:   </os>
Jul 27 18:02:10 user nova-compute[71206]:   <features>
Jul 27 18:02:10 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:10 user nova-compute[71206]:     <apic/>
Jul 27 18:02:10 user nova-compute[71206]:     <vmcoreinfo state='on'/>
Jul 27 18:02:10 user nova-compute[71206]:   </features>
Jul 27 18:02:10 user nova-compute[71206]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 18:02:10 user nova-compute[71206]:     <model fallback='forbid'>Nehalem</model>
Jul 27 18:02:10 user nova-compute[71206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='vme'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='x2apic'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='hypervisor'/>
Jul 27 18:02:10 user nova-compute[71206]:   </cpu>
Jul 27 18:02:10 user nova-compute[71206]:   <clock offset='utc'>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='hpet' present='no'/>
Jul 27 18:02:10 user nova-compute[71206]:   </clock>
Jul 27 18:02:10 user nova-compute[71206]:   <on_poweroff>destroy</on_poweroff>
Jul 27 18:02:10 user nova-compute[71206]:   <on_reboot>restart</on_reboot>
Jul 27 18:02:10 user nova-compute[71206]:   <on_crash>destroy</on_crash>
Jul 27 18:02:10 user nova-compute[71206]:   <devices>
Jul 27 18:02:10 user nova-compute[71206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 18:02:10 user nova-compute[71206]:     <disk type='file' device='disk'>
Jul 27 18:02:10 user nova-compute[71206]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 18:02:10 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk' index='2'/>
Jul 27 18:02:10 user nova-compute[71206]:       <backingStore type='file' index='3'>
Jul 27 18:02:10 user nova-compute[71206]:         <format type='raw'/>
Jul 27 18:02:10 user nova-compute[71206]:         <source file='/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1'/>
Jul 27 18:02:10 user nova-compute[71206]:         <backingStore/>
Jul 27 18:02:10 user nova-compute[71206]:       </backingStore>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='vda' bus='virtio'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='virtio-disk0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </disk>
Jul 27 18:02:10 user nova-compute[71206]:     <disk type='file' device='cdrom'>
Jul 27 18:02:10 user nova-compute[71206]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 18:02:10 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config' index='1'/>
Jul 27 18:02:10 user nova-compute[71206]:       <backingStore/>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='hda' bus='ide'/>
Jul 27 18:02:10 user nova-compute[71206]:       <readonly/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='ide0-0-0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </disk>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='usb' index='0' model='none'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='usb'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='pci.0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='ide' index='0'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='ide'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <interface type='ethernet'>
Jul 27 18:02:10 user nova-compute[71206]:       <mac address='fa:16:3e:57:be:a8'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='tap2846403b-4b'/>
Jul 27 18:02:10 user nova-compute[71206]:       <model type='virtio'/>
Jul 27 18:02:10 user nova-compute[71206]:       <mtu size='1442'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='net0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </interface>
Jul 27 18:02:10 user nova-compute[71206]:     <serial type='pty'>
Jul 27 18:02:10 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:10 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target type='isa-serial' port='0'>
Jul 27 18:02:10 user nova-compute[71206]:         <model name='isa-serial'/>
Jul 27 18:02:10 user nova-compute[71206]:       </target>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </serial>
Jul 27 18:02:10 user nova-compute[71206]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 18:02:10 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:10 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target type='serial' port='0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </console>
Jul 27 18:02:10 user nova-compute[71206]:     <input type='mouse' bus='ps2'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='input0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </input>
Jul 27 18:02:10 user nova-compute[71206]:     <input type='keyboard' bus='ps2'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='input1'/>
Jul 27 18:02:10 user nova-compute[71206]:     </input>
Jul 27 18:02:10 user nova-compute[71206]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 18:02:10 user nova-compute[71206]:       <listen type='address' address='0.0.0.0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </graphics>
Jul 27 18:02:10 user nova-compute[71206]:     <audio id='1' type='none'/>
Jul 27 18:02:10 user nova-compute[71206]:     <video>
Jul 27 18:02:10 user nova-compute[71206]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='video0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </video>
Jul 27 18:02:10 user nova-compute[71206]:     <memballoon model='virtio'>
Jul 27 18:02:10 user nova-compute[71206]:       <stats period='10'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='balloon0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:10 user nova-compute[71206]:     <rng model='virtio'>
Jul 27 18:02:10 user nova-compute[71206]:       <backend model='random'>/dev/urandom</backend>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='rng0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </rng>
Jul 27 18:02:10 user nova-compute[71206]:   </devices>
Jul 27 18:02:10 user nova-compute[71206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 18:02:10 user nova-compute[71206]:     <label>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</label>
Jul 27 18:02:10 user nova-compute[71206]:     <imagelabel>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</imagelabel>
Jul 27 18:02:10 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:10 user nova-compute[71206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 18:02:10 user nova-compute[71206]:     <label>+64055:+108</label>
Jul 27 18:02:10 user nova-compute[71206]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 18:02:10 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:10 user nova-compute[71206]: </domain>
Jul 27 18:02:10 user nova-compute[71206]:  {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface> {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ab:21"/><model type="virtio"/><mtu size="1442"/><target dev="tap26ce03e4-94"/></interface>not found in domain: <domain type='kvm' id='10'>
Jul 27 18:02:10 user nova-compute[71206]:   <name>instance-00000009</name>
Jul 27 18:02:10 user nova-compute[71206]:   <uuid>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</uuid>
Jul 27 18:02:10 user nova-compute[71206]:   <metadata>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:10 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:02:09</nova:creationTime>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:10 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:10 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:10 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:10 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:10 user nova-compute[71206]:   </metadata>
Jul 27 18:02:10 user nova-compute[71206]:   <memory unit='KiB'>524288</memory>
Jul 27 18:02:10 user nova-compute[71206]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 18:02:10 user nova-compute[71206]:   <vcpu placement='static'>1</vcpu>
Jul 27 18:02:10 user nova-compute[71206]:   <resource>
Jul 27 18:02:10 user nova-compute[71206]:     <partition>/machine</partition>
Jul 27 18:02:10 user nova-compute[71206]:   </resource>
Jul 27 18:02:10 user nova-compute[71206]:   <sysinfo type='smbios'>
Jul 27 18:02:10 user nova-compute[71206]:     <system>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='version'>0.0.0</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='serial'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='uuid'>94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</entry>
Jul 27 18:02:10 user nova-compute[71206]:       <entry name='family'>Virtual Machine</entry>
Jul 27 18:02:10 user nova-compute[71206]:     </system>
Jul 27 18:02:10 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:10 user nova-compute[71206]:   <os>
Jul 27 18:02:10 user nova-compute[71206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 18:02:10 user nova-compute[71206]:     <boot dev='hd'/>
Jul 27 18:02:10 user nova-compute[71206]:     <smbios mode='sysinfo'/>
Jul 27 18:02:10 user nova-compute[71206]:   </os>
Jul 27 18:02:10 user nova-compute[71206]:   <features>
Jul 27 18:02:10 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:10 user nova-compute[71206]:     <apic/>
Jul 27 18:02:10 user nova-compute[71206]:     <vmcoreinfo state='on'/>
Jul 27 18:02:10 user nova-compute[71206]:   </features>
Jul 27 18:02:10 user nova-compute[71206]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 18:02:10 user nova-compute[71206]:     <model fallback='forbid'>Nehalem</model>
Jul 27 18:02:10 user nova-compute[71206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='vme'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='x2apic'/>
Jul 27 18:02:10 user nova-compute[71206]:     <feature policy='require' name='hypervisor'/>
Jul 27 18:02:10 user nova-compute[71206]:   </cpu>
Jul 27 18:02:10 user nova-compute[71206]:   <clock offset='utc'>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 18:02:10 user nova-compute[71206]:     <timer name='hpet' present='no'/>
Jul 27 18:02:10 user nova-compute[71206]:   </clock>
Jul 27 18:02:10 user nova-compute[71206]:   <on_poweroff>destroy</on_poweroff>
Jul 27 18:02:10 user nova-compute[71206]:   <on_reboot>restart</on_reboot>
Jul 27 18:02:10 user nova-compute[71206]:   <on_crash>destroy</on_crash>
Jul 27 18:02:10 user nova-compute[71206]:   <devices>
Jul 27 18:02:10 user nova-compute[71206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 18:02:10 user nova-compute[71206]:     <disk type='file' device='disk'>
Jul 27 18:02:10 user nova-compute[71206]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 18:02:10 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk' index='2'/>
Jul 27 18:02:10 user nova-compute[71206]:       <backingStore type='file' index='3'>
Jul 27 18:02:10 user nova-compute[71206]:         <format type='raw'/>
Jul 27 18:02:10 user nova-compute[71206]:         <source file='/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1'/>
Jul 27 18:02:10 user nova-compute[71206]:         <backingStore/>
Jul 27 18:02:10 user nova-compute[71206]:       </backingStore>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='vda' bus='virtio'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='virtio-disk0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </disk>
Jul 27 18:02:10 user nova-compute[71206]:     <disk type='file' device='cdrom'>
Jul 27 18:02:10 user nova-compute[71206]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 18:02:10 user nova-compute[71206]:       <source file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk.config' index='1'/>
Jul 27 18:02:10 user nova-compute[71206]:       <backingStore/>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='hda' bus='ide'/>
Jul 27 18:02:10 user nova-compute[71206]:       <readonly/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='ide0-0-0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </disk>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='usb' index='0' model='none'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='usb'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='pci.0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <controller type='ide' index='0'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='ide'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 18:02:10 user nova-compute[71206]:     </controller>
Jul 27 18:02:10 user nova-compute[71206]:     <interface type='ethernet'>
Jul 27 18:02:10 user nova-compute[71206]:       <mac address='fa:16:3e:57:be:a8'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target dev='tap2846403b-4b'/>
Jul 27 18:02:10 user nova-compute[71206]:       <model type='virtio'/>
Jul 27 18:02:10 user nova-compute[71206]:       <mtu size='1442'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='net0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </interface>
Jul 27 18:02:10 user nova-compute[71206]:     <serial type='pty'>
Jul 27 18:02:10 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:10 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target type='isa-serial' port='0'>
Jul 27 18:02:10 user nova-compute[71206]:         <model name='isa-serial'/>
Jul 27 18:02:10 user nova-compute[71206]:       </target>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </serial>
Jul 27 18:02:10 user nova-compute[71206]:     <console type='pty' tty='/dev/pts/9'>
Jul 27 18:02:10 user nova-compute[71206]:       <source path='/dev/pts/9'/>
Jul 27 18:02:10 user nova-compute[71206]:       <log file='/opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/console.log' append='off'/>
Jul 27 18:02:10 user nova-compute[71206]:       <target type='serial' port='0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='serial0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </console>
Jul 27 18:02:10 user nova-compute[71206]:     <input type='mouse' bus='ps2'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='input0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </input>
Jul 27 18:02:10 user nova-compute[71206]:     <input type='keyboard' bus='ps2'>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='input1'/>
Jul 27 18:02:10 user nova-compute[71206]:     </input>
Jul 27 18:02:10 user nova-compute[71206]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 18:02:10 user nova-compute[71206]:       <listen type='address' address='0.0.0.0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </graphics>
Jul 27 18:02:10 user nova-compute[71206]:     <audio id='1' type='none'/>
Jul 27 18:02:10 user nova-compute[71206]:     <video>
Jul 27 18:02:10 user nova-compute[71206]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='video0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </video>
Jul 27 18:02:10 user nova-compute[71206]:     <memballoon model='virtio'>
Jul 27 18:02:10 user nova-compute[71206]:       <stats period='10'/>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='balloon0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:10 user nova-compute[71206]:     <rng model='virtio'>
Jul 27 18:02:10 user nova-compute[71206]:       <backend model='random'>/dev/urandom</backend>
Jul 27 18:02:10 user nova-compute[71206]:       <alias name='rng0'/>
Jul 27 18:02:10 user nova-compute[71206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 18:02:10 user nova-compute[71206]:     </rng>
Jul 27 18:02:10 user nova-compute[71206]:   </devices>
Jul 27 18:02:10 user nova-compute[71206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 18:02:10 user nova-compute[71206]:     <label>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</label>
Jul 27 18:02:10 user nova-compute[71206]:     <imagelabel>libvirt-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13</imagelabel>
Jul 27 18:02:10 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:10 user nova-compute[71206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 18:02:10 user nova-compute[71206]:     <label>+64055:+108</label>
Jul 27 18:02:10 user nova-compute[71206]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 18:02:10 user nova-compute[71206]:   </seclabel>
Jul 27 18:02:10 user nova-compute[71206]: </domain>
Jul 27 18:02:10 user nova-compute[71206]:  {{(pid=71206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 18:02:10 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Detaching interface fa:16:3e:7a:ab:21 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap26ce03e4-94' not found.
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Converting VIF {"id": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "address": "fa:16:3e:7a:ab:21", "network": {"id": "566d9934-5397-46de-a050-8817b400d34b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245626891", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ce03e4-94", "ovs_interfaceid": "26ce03e4-9476-4d88-94d5-da753e5e82ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG os_vif [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26ce03e4-94, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:02:10 user nova-compute[71206]: INFO os_vif [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ab:21,bridge_name='br-int',has_traffic_filtering=True,id=26ce03e4-9476-4d88-94d5-da753e5e82ef,network=Network(566d9934-5397-46de-a050-8817b400d34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ce03e4-94')
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [req-75af0879-7222-4f3f-8686-0627a8a73a6a req-6b95b348-0c7c-4a5e-9aa1-023abba703b5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:10 user nova-compute[71206]:   <nova:package version="0.0.0"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:name>tempest-device-tagging-server-604937323</nova:name>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:creationTime>2023-07-27 18:02:10</nova:creationTime>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:flavor name="m1.tiny">
Jul 27 18:02:10 user nova-compute[71206]:     <nova:memory>512</nova:memory>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:disk>1</nova:disk>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:swap>0</nova:swap>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:flavor>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:user uuid="411afe8aa87048debd9703a1b141eb01">tempest-TaggedAttachmentsTest-206507824-project-member</nova:user>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:project uuid="679da984d9634ff18a2af5f57475a990">tempest-TaggedAttachmentsTest-206507824</nova:project>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:owner>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:10 user nova-compute[71206]:   <nova:ports>
Jul 27 18:02:10 user nova-compute[71206]:     <nova:port uuid="2846403b-4b4b-45d6-913f-aca6ec36385e">
Jul 27 18:02:10 user nova-compute[71206]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:02:10 user nova-compute[71206]:     </nova:port>
Jul 27 18:02:10 user nova-compute[71206]:   </nova:ports>
Jul 27 18:02:10 user nova-compute[71206]: </nova:instance>
Jul 27 18:02:10 user nova-compute[71206]:  {{(pid=71206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 18:02:10 user nova-compute[71206]: INFO nova.network.neutron [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Port 26ce03e4-9476-4d88-94d5-da753e5e82ef from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 27 18:02:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [{"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Releasing lock "refresh_cache-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-155352ce-b3f0-4bdc-afe1-59eac4f1441a tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "interface-94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-26ce03e4-9476-4d88-94d5-da753e5e82ef" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.731s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:11 user nova-compute[71206]: WARNING nova.compute.manager [req-93cab434-ea81-4191-b6fe-7e4a0dd8d9c3 req-0c921d4d-4f26-4978-bde3-8425d19df1b8 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-26ce03e4-9476-4d88-94d5-da753e5e82ef for instance with vm_state active and task_state None.
Jul 27 18:02:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYKDvqCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:15 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:15 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:15 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7845c379-7226-47bc-a283-f3607bc6c7d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:15 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[049856bd-9f86-4b74-8bcb-6bd61ec7903d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496] added
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1c39e-47ef-4423-8621-e4b285f61cfb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a4818c-b561-449e-9364-b4e8eb87b6bd]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYKDvqCx {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYKDvqCx" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f9f89-7a9c-4c88-bc96-5dad54568222]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYKDvqCx'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b84a7-46ab-4f8f-89db-9bfb4ebcd4c4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92758e5-6a4a-43a7-b5a2-957875a7dcac]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10816cb-d397-43d2-b0ff-010cf6878975]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260]
Jul 27 18:02:15 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2757fc0-4759-4e5a-9217-2cd3e7244ab8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52db666-3ba8-4231-9524-4e4e04994af6]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4b609a-e9c5-4c32-b2b6-1fef718098c0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'serial': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '73cb326f-4e7a-4eb9-a845-515577a00945', 'serial'} {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:16 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYKDvqCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23662313063633534', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313063633534', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.605s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:16 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:16 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'flavor' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f6366-cdfd-4ef7-b15b-601edb507cf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:16 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:02:16 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:16 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:16 user nova-compute[71206]:   <target dev="sdc" bus="scsi"/>
Jul 27 18:02:16 user nova-compute[71206]:   <serial>37a369b3-ae90-437c-abba-562c74b8e496</serial>
Jul 27 18:02:16 user nova-compute[71206]:   <address type="drive" controller="0" unit="2"/>
Jul 27 18:02:16 user nova-compute[71206]: </disk>
Jul 27 18:02:16 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd7b70f-e779-4979-97ec-2dcad87bfe04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02] added
Jul 27 18:02:16 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d7a7c5-8709-4087-91a9-8bc28b2a4d4f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead5a19-1a7d-4490-827d-24ff17eae8b1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxAsLDup {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxAsLDup" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e81f9-8f4f-42bb-9faa-f39764513eed]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxAsLDup'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f4697-83f3-437f-96a0-1100cc9ab888]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff81e8ee-bbe3-43e0-b544-5b8814f9ee6a]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a1451-861f-4e24-b7f8-ef9d00e6993a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260]
Jul 27 18:02:17 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e47a83-e2fc-4228-82a5-467971be1704]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5b2c3-42ce-4fd6-ad97-b73b91751a6b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d2778-a0e4-419a-91cc-c5fe81bfc7ed]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No BDM found with device name sda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] No VIF found with MAC fa:16:3e:28:70:60, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0a8c1460-c987-4dc1-9a80-e38f4dd2b43b tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.406s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== connect_volume: return (1893ms) {'type': 'block', 'scsi_wwn': '23637393864326666', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637393864326666', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lazy-loading 'flavor' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:18 user nova-compute[71206]: INFO nova.compute.manager [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Detaching volume 37a369b3-ae90-437c-abba-562c74b8e496
Jul 27 18:02:18 user nova-compute[71206]: INFO nova.virt.block_device [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Attempting to driver detach volume 37a369b3-ae90-437c-abba-562c74b8e496 from mountpoint /dev/sdc
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Attempting to detach device sdc from instance de639534-60e8-4cd1-bcc8-92a29efd0610 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:18 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:18 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:18 user nova-compute[71206]:   <target dev="sdc" bus="scsi"/>
Jul 27 18:02:18 user nova-compute[71206]:   <serial>37a369b3-ae90-437c-abba-562c74b8e496</serial>
Jul 27 18:02:18 user nova-compute[71206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 18:02:18 user nova-compute[71206]: </disk>
Jul 27 18:02:18 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Successfully detached device sdc from instance de639534-60e8-4cd1-bcc8-92a29efd0610 from the persistent domain config.
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance de639534-60e8-4cd1-bcc8-92a29efd0610 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:18 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:18 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:18 user nova-compute[71206]:   <target dev="sdc" bus="scsi"/>
Jul 27 18:02:18 user nova-compute[71206]:   <serial>37a369b3-ae90-437c-abba-562c74b8e496</serial>
Jul 27 18:02:18 user nova-compute[71206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 18:02:18 user nova-compute[71206]: </disk>
Jul 27 18:02:18 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690480938.9262717, de639534-60e8-4cd1-bcc8-92a29efd0610 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:02:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Successfully detached device sdc from instance de639534-60e8-4cd1-bcc8-92a29efd0610 from the live domain config.
Jul 27 18:02:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYKDvqCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:18 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[07705793-873f-4318-91fd-e9be25588daf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:18 user nova-compute[71206]: No targets found.
Jul 27 18:02:18 user nova-compute[71206]: iSNS:
Jul 27 18:02:18 user nova-compute[71206]: No targets found.
Jul 27 18:02:18 user nova-compute[71206]: STATIC:
Jul 27 18:02:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02
Jul 27 18:02:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496
Jul 27 18:02:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:18 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:18 user nova-compute[71206]: No targets found.
Jul 27 18:02:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:18 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:18 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[35014e66-f825-4d79-9c45-b57ca24418ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bea355-477a-4350-97ad-5b5aac82ad22]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24264dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57b44aa-3104-4fef-9cee-51b0266ec806]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb615d-c986-4695-8cb0-1b3b1d94513f]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8718d-1c34-4cc0-b3ab-260b2d0073b4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc1e7e3-2ce0-4f79-aa68-72459988913f]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[200b76bf-502d-40a3-bc7c-e25bc1429967]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2a411-1d11-4b5a-99ef-867751b12b11]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260]
Jul 27 18:02:19 user nova-compute[71206]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37a369b3-ae90-437c-abba-562c74b8e496 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f2af8-5c0d-46ef-b5e4-63386aa84be4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] <== disconnect_volume: return (391ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 304087040 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 464519168 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'flavor' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 620756992 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23840e6b-7d74-4b60-9d9c-dab9ed74d9f8 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.356s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 796917760 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:02:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:22 user nova-compute[71206]: INFO nova.compute.manager [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Terminating instance
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0734816-a63d-4357-aef0-fd3adc35ecb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:22 user nova-compute[71206]: No targets found.
Jul 27 18:02:22 user nova-compute[71206]: iSNS:
Jul 27 18:02:22 user nova-compute[71206]: No targets found.
Jul 27 18:02:22 user nova-compute[71206]: STATIC:
Jul 27 18:02:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02
Jul 27 18:02:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:22 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:22 user nova-compute[71206]: No targets found.
Jul 27 18:02:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:22 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:22 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae421e-69fc-41f9-a163-ec613b9c65a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9ec67b-f66b-4edd-9802-84b9f60fb48e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:22 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:22 user nova-compute[71206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e3289fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f97ef9-54cf-45e9-9963-1bbe1f88457f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46219f0e-98a3-4611-b79c-9bdf0f225a5e]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4adda2-e29a-4f13-9f4c-0ba17dfc7601]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c15d615-09f7-4afd-b731-c59a97beaabd]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-unplugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] No waiting events found dispatching network-vif-unplugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-58f00ee4-b521-4d31-b05a-43ba79a331f8 req-16ea640b-6871-4fa9-b1a8-d342a34f5f87 service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-unplugged-56c61374-8bca-47a0-af37-41ee6e2ea991 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb37f4-7fc9-4ef5-9e8c-76a9519b170e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3941b991-4a87-4d00-bea0-34f19c085e91]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]
Jul 27 18:02:22 user nova-compute[71206]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c892a3-a90a-4b8d-953c-327bcf7fbd35]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== disconnect_volume: return (320ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'serial'} {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: removing Cinder connection for volume 73cb326f-4e7a-4eb9-a845-515577a00945 {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Instance destroyed successfully.
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lazy-loading 'resources' on Instance uuid de639534-60e8-4cd1-bcc8-92a29efd0610 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:00:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-782799389',display_name='tempest-AttachSCSIVolumeTestJSON-server-782799389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-782799389',id=12,image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOffYtYiRVi7ryqXefpwDZLXVSCzoIexZ2QquXpStKhKs3atb7HrKZfvkBO75BWiv1zIwpU2bmVKCmkIMQt7eS49n73eq4FHQ4lRcPy89ob+m2kKOS6ix51uM/ouzCB02g==',key_name='tempest-keypair-924617423',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca32306d231b4555aa6fdaa714432969',ramdisk_id='',reservation_id='r-q2xbrurm',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7aa25195-27a5-4dcd-aa47-f0736761d20d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1701240709',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1701240709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='334f1dea9095424eb0dc1d03623b2236',uuid=de639534-60e8-4cd1-bcc8-92a29efd0610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converting VIF {"id": "56c61374-8bca-47a0-af37-41ee6e2ea991", "address": "fa:16:3e:28:70:60", "network": {"id": "925d5fef-af82-45cc-8c15-8c769eb7ba3d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890853905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca32306d231b4555aa6fdaa714432969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c61374-8b", "ovs_interfaceid": "56c61374-8bca-47a0-af37-41ee6e2ea991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG os_vif [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c61374-8b, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:02:22 user nova-compute[71206]: INFO os_vif [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:70:60,bridge_name='br-int',has_traffic_filtering=True,id=56c61374-8bca-47a0-af37-41ee6e2ea991,network=Network(925d5fef-af82-45cc-8c15-8c769eb7ba3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c61374-8b')
Jul 27 18:02:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Deleting instance files /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610_del
Jul 27 18:02:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Deletion of /opt/stack/data/nova/instances/de639534-60e8-4cd1-bcc8-92a29efd0610_del complete
Jul 27 18:02:23 user nova-compute[71206]: INFO nova.compute.manager [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: Updating volume 73cb326f-4e7a-4eb9-a845-515577a00945 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SxAsLDup", "auth_password": "mE4528XwgMUsRT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "42476c2a-8f61-4ec8-a4f6-6339cc9ebe02"}, "status": "reserved", "instance": "24390c1b-61e1-4a56-92ae-cd7b79e67da6", "attached_at": "", "detached_at": "", "volume_id": "42476c2a-8f61-4ec8-a4f6-6339cc9ebe02", "serial": "42476c2a-8f61-4ec8-a4f6-6339cc9ebe02"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'no_device': None, 'attachment_id': 'bddd138d-17f0-4d2e-bd08-c616caa4b577'} {{(pid=71206) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ecf2d217-e62c-49ac-b642-07ccfd51c695 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.956s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Took 1.38 seconds to deallocate network for instance.
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] Acquiring lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] No waiting events found dispatching network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:24 user nova-compute[71206]: WARNING nova.compute.manager [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received unexpected event network-vif-plugged-56c61374-8bca-47a0-af37-41ee6e2ea991 for instance with vm_state deleted and task_state None.
Jul 27 18:02:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-14501ab5-7b1c-4cf3-94ce-f46c77531247 req-b76b54f5-ee81-4ba2-ae1a-a609dda5883a service nova] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Received event network-vif-deleted-56c61374-8bca-47a0-af37-41ee6e2ea991 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[358670f4-084f-44de-a7a4-96aec6b2223d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5321c-1bf8-47ad-a3b5-e257d7a6ef3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0adc98-c328-4a41-806c-edc33f9fd3d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955fb33-fd96-4fe6-940f-c84b3edd84ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:24 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:02:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad2d71-e71e-4bfb-9556-ee308da6f79c]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:02:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:25 user nova-compute[71206]: INFO nova.compute.manager [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Swapping volume 42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 for 73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:25 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Deleted allocations for instance de639534-60e8-4cd1-bcc8-92a29efd0610
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f3206fd8-c4b4-4689-ae98-45c4342f9ad6 tempest-AttachSCSIVolumeTestJSON-1701240709 tempest-AttachSCSIVolumeTestJSON-1701240709-project-member] Lock "de639534-60e8-4cd1-bcc8-92a29efd0610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.228s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:26 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'de639534-60e8-4cd1-bcc8-92a29efd0610' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'de639534-60e8-4cd1-bcc8-92a29efd0610' (instance-0000000c)
Jul 27 18:02:27 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:27 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=6889MB free_disk=25.55545425415039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a9eaffca-4af0-4208-95be-2894eec95276 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:02:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '73cb326f-4e7a-4eb9-a845-515577a00945', 'serial': '73cb326f-4e7a-4eb9-a845-515577a00945'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02'}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'serial'} {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:32 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fd06f-4863-480e-abde-43e88eebfc3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62628017-e51f-4926-90d4-46b4464a24f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945] added
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f9f323-3b44-4547-bd97-d2ef10f9d206]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd357bd-2d08-4e32-a387-bb01af4b2bb3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqDSLalO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqDSLalO" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c6368-2060-49bb-8abc-e0377a88c8e6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YqDSLalO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c1ac5-2f9d-4474-ab79-5d3fa779a2f3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71906bbd-a4dc-4627-953c-80613da62280]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e1912-bb39-4e0e-8408-c0b4aa9902da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]
Jul 27 18:02:32 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a513bab8-0d86-445a-bef2-5d7a50bdf51e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6522b3-8016-449c-9a96-0faa3bdff3cb]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662b649-7e5b-42f4-b1b1-e3a746c6dcec]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26562643034633336', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562643034633336', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG nova.objects.instance [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lazy-loading 'flavor' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:02:33 user nova-compute[71206]: INFO nova.compute.claims [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Claim successful on node user
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:02:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:02:34 user nova-compute[71206]: INFO nova.virt.block_device [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Booting with blank volume at /dev/vda
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:34 user nova-compute[71206]: DEBUG nova.policy [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ed5535b566e42f195aebce82e14ced7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72bcdbc35df444c99f3d4045832c9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:02:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 253755392 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Successfully created port: 2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:02:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 423624704 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:36 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Successfully updated port: 2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-changed-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Refreshing instance network info cache due to event network-changed-2da326ce-e53a-43c4-9cf5-0ba3bab0527d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 894435328 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 1038090240 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance network_info: |[{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.network.neutron [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Refreshing network info cache for port 2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690480942.9242568, de639534-60e8-4cd1-bcc8-92a29efd0610 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:37 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] VM Stopped (Lifecycle Event)
Jul 27 18:02:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d38b21c7-15ef-4b86-8e8b-9044c6804fed None None] [instance: de639534-60e8-4cd1-bcc8-92a29efd0610] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxAsLDup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '42476c2a-8f61-4ec8-a4f6-6339cc9ebe02'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:38 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92789566-815d-427f-a06e-c64667136b34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:38 user nova-compute[71206]: No targets found.
Jul 27 18:02:38 user nova-compute[71206]: iSNS:
Jul 27 18:02:38 user nova-compute[71206]: No targets found.
Jul 27 18:02:38 user nova-compute[71206]: STATIC:
Jul 27 18:02:38 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02
Jul 27 18:02:38 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:38 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:38 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:38 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:38 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:38 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:38 user nova-compute[71206]: No targets found.
Jul 27 18:02:38 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:38 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:38 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a230bba-0bf3-4dc1-b5aa-640d81b9a224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1f89c-d1d2-43f4-86e3-294b87bf54ce]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:38 user nova-compute[71206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:38 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 (non-flash)
Jul 27 18:02:38 user nova-compute[71206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:38 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2c192290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[086794fb-1c6b-4b42-a8c6-13c25d3ad443]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72750ed3-8f4a-4243-a2c6-3c863819ab67]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d0415-2f59-4ca1-896e-988a7a53d896]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691e6c2-6747-442c-95bb-987d9910b23f]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad49838-c94c-4a1c-8e8f-3bbec96b15f6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a5792-10b7-47cb-aaba-4c7c75c939a7]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260]
Jul 27 18:02:38 user nova-compute[71206]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:38 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c058156-c25d-4ed1-abc0-5e36805abd82]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] <== disconnect_volume: return (348ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '24390c1b-61e1-4a56-92ae-cd7b79e67da6', 'attached_at': '', 'detached_at': '', 'volume_id': '73cb326f-4e7a-4eb9-a845-515577a00945', 'serial'} {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 18:02:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: removing Cinder connection for volume 42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 {{(pid=71206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updated VIF entry in instance network info cache for port 2da326ce-e53a-43c4-9cf5-0ba3bab0527d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0a38d8a4-38de-48d4-976c-7ca31914377a req-e80682a7-f3e8-4f39-95fe-8f9ad67e7a82 service nova] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] swap_volume: Updating volume 42476c2a-8f61-4ec8-a4f6-6339cc9ebe02 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YqDSLalO", "auth_password": "9OcbPfZx1RmkNK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "73cb326f-4e7a-4eb9-a845-515577a00945"}, "status": "reserved", "instance": "24390c1b-61e1-4a56-92ae-cd7b79e67da6", "attached_at": "", "detached_at": "", "volume_id": "73cb326f-4e7a-4eb9-a845-515577a00945", "serial": "73cb326f-4e7a-4eb9-a845-515577a00945"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '73cb326f-4e7a-4eb9-a845-515577a00945', 'no_device': None, 'attachment_id': 'c746ba94-a74d-46c5-80dc-98a7282c34e0'} {{(pid=71206) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18e58ec8-6812-4c2a-807b-2cd3dd232109 tempest-TestVolumeSwap-1199784059 tempest-TestVolumeSwap-1199784059-project-admin] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.021s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:39 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:02:39 user nova-compute[71206]: INFO nova.compute.claims [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Claim successful on node user
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.compute.manager [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Detaching volume 73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.utils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.virt.block_device [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Attempting to driver detach volume 73cb326f-4e7a-4eb9-a845-515577a00945 from mountpoint /dev/vdb
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711de63-169a-4eeb-ba35-0b03ce5317e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f30297a-85b3-4df8-b4a1-75956fd2d639]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Attempting to detach device vdb from instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:40 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:40 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:40 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:40 user nova-compute[71206]:   <serial>73cb326f-4e7a-4eb9-a845-515577a00945</serial>
Jul 27 18:02:40 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:02:40 user nova-compute[71206]: </disk>
Jul 27 18:02:40 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Successfully detached device vdb from instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 from the persistent domain config.
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:02:40 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:40 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:02:40 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:02:40 user nova-compute[71206]:   <serial>73cb326f-4e7a-4eb9-a845-515577a00945</serial>
Jul 27 18:02:40 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:02:40 user nova-compute[71206]: </disk>
Jul 27 18:02:40 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e9ac1f-5ea8-42f2-b661-7010f7b27fc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565e57b-e701-48fe-83e5-4e985f6cbbcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:02:40 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[351cfe42-a5ff-4fb2-b30d-08d6dcef959b]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.utils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating existing volume attachment record: 6f5fbfde-645d-4ac0-8e93-45d26a20e705 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.policy [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67d54156d44349cbb9e2076cf2799bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d3c8a7014948aaa46fde6a6c6fd623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Creating image(s)
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "/opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "/opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "/opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690480960.9040759, 24390c1b-61e1-4a56-92ae-cd7b79e67da6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:02:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Successfully detached device vdb from instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 from the live domain config.
Jul 27 18:02:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqDSLalO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '73cb326f-4e7a-4eb9-a845-515577a00945'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffe063-b041-438c-a11f-590a3605a48b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:02:40 user nova-compute[71206]: No targets found.
Jul 27 18:02:40 user nova-compute[71206]: iSNS:
Jul 27 18:02:40 user nova-compute[71206]: No targets found.
Jul 27 18:02:40 user nova-compute[71206]: STATIC:
Jul 27 18:02:40 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945
Jul 27 18:02:40 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:02:40 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:02:40 user nova-compute[71206]: FIRMWARE:
Jul 27 18:02:40 user nova-compute[71206]: No targets found.
Jul 27 18:02:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:02:40 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:02:40 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42336fd6-9100-4558-8222-c424c9567e5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f005ec-637b-498f-9366-f09573e416de]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 (non-flash)
Jul 27 18:02:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24355d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.222s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b442850-0866-4402-b809-3357680cc08f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db89d57-d2da-467f-8718-06933bf15ff5]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d576eff-6a2f-47fb-bdca-707e7890e9bc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8f625-1d2b-4d25-b19a-b3668a67fb4a]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec69c2-f1ad-4a1c-8335-ec8bf64ac6c1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk 1073741824" returned: 0 in 0.048s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[102fe5bc-e942-427b-8d0a-b38f3c0cd33b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260]
Jul 27 18:02:41 user nova-compute[71206]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73cb326f-4e7a-4eb9-a845-515577a00945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ed3cc-a2c9-4fab-8300-37dae8328158]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] <== disconnect_volume: return (403ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Successfully created port: 2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Cannot resize image /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'migration_context' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'flavor' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-65f66ab5-a58a-4152-8657-44df5fe9e9da tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.753s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Successfully updated port: 2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquired lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-changed-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Refreshing instance network info cache due to event network-changed-2253410a-aa7f-409b-9519-32fcdf1f3bf4. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] Acquiring lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating instance_info_cache with network_info: [{"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Releasing lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Instance network_info: |[{"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] Acquired lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.neutron [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Refreshing network info cache for port 2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Start _get_guest_xml network_info=[{"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:02:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-337632116',display_name='tempest-TestServerVolumeAttachmentScenario-server-337632116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-337632116',id=15,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vHmZugU3Oma8fLl/VXIn7mQqwQ3VqyVUIRDT2vHEWq4bTGSA+0jwNBdhFULKEbdyIgmAuzHC7+31T5MxX40tc5RSLWqT/Mxx7dPDqV0QD3gFRjejMOzxBsarCjBe9BQ==',key_name='tempest-keypair-1414437643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83d3c8a7014948aaa46fde6a6c6fd623',ramdisk_id='',reservation_id='r-eeuurb4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-836302792',owner_user_name='tempest-TestServerVolumeAttachmentScenario-836302792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d54156d44349cbb9e2076cf2799bd0',uuid=764b00ce-48cb-472a-9bcd-0546f6cf3c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converting VIF {"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'pci_devices' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:02:42 user nova-compute[71206]:   <uuid>764b00ce-48cb-472a-9bcd-0546f6cf3c4c</uuid>
Jul 27 18:02:42 user nova-compute[71206]:   <name>instance-0000000f</name>
Jul 27 18:02:42 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:02:42 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:02:42 user nova-compute[71206]:   <metadata>
Jul 27 18:02:42 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:42 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-337632116</nova:name>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:02:42</nova:creationTime>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:02:42 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:42 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:owner>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:user uuid="67d54156d44349cbb9e2076cf2799bd0">tempest-TestServerVolumeAttachmentScenario-836302792-project-member</nova:user>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:project uuid="83d3c8a7014948aaa46fde6a6c6fd623">tempest-TestServerVolumeAttachmentScenario-836302792</nova:project>
Jul 27 18:02:42 user nova-compute[71206]:       </nova:owner>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:42 user nova-compute[71206]:       <nova:ports>
Jul 27 18:02:42 user nova-compute[71206]:         <nova:port uuid="2253410a-aa7f-409b-9519-32fcdf1f3bf4">
Jul 27 18:02:42 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 18:02:42 user nova-compute[71206]:         </nova:port>
Jul 27 18:02:42 user nova-compute[71206]:       </nova:ports>
Jul 27 18:02:42 user nova-compute[71206]:     </nova:instance>
Jul 27 18:02:42 user nova-compute[71206]:   </metadata>
Jul 27 18:02:42 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:02:42 user nova-compute[71206]:     <system>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="serial">764b00ce-48cb-472a-9bcd-0546f6cf3c4c</entry>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="uuid">764b00ce-48cb-472a-9bcd-0546f6cf3c4c</entry>
Jul 27 18:02:42 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:02:42 user nova-compute[71206]:     </system>
Jul 27 18:02:42 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:42 user nova-compute[71206]:   <os>
Jul 27 18:02:42 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:02:42 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:02:42 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:02:42 user nova-compute[71206]:   </os>
Jul 27 18:02:42 user nova-compute[71206]:   <features>
Jul 27 18:02:42 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:42 user nova-compute[71206]:     <apic/>
Jul 27 18:02:42 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:02:42 user nova-compute[71206]:   </features>
Jul 27 18:02:42 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:02:42 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:02:42 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:02:42 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:02:42 user nova-compute[71206]:   </clock>
Jul 27 18:02:42 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:02:42 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:02:42 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:02:42 user nova-compute[71206]:   </cpu>
Jul 27 18:02:42 user nova-compute[71206]:   <devices>
Jul 27 18:02:42 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:02:42 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:02:42 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk"/>
Jul 27 18:02:42 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:02:42 user nova-compute[71206]:     </disk>
Jul 27 18:02:42 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:02:42 user nova-compute[71206]:       <mac address="fa:16:3e:77:4c:d7"/>
Jul 27 18:02:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:02:42 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:02:42 user nova-compute[71206]:       <target dev="tap2253410a-aa"/>
Jul 27 18:02:42 user nova-compute[71206]:     </interface>
Jul 27 18:02:42 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:02:42 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/console.log" append="off"/>
Jul 27 18:02:42 user nova-compute[71206]:     </serial>
Jul 27 18:02:42 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:02:42 user nova-compute[71206]:     <video>
Jul 27 18:02:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:02:42 user nova-compute[71206]:     </video>
Jul 27 18:02:42 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:02:42 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:02:42 user nova-compute[71206]:     </rng>
Jul 27 18:02:42 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:02:42 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:02:42 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:02:42 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:42 user nova-compute[71206]:   </devices>
Jul 27 18:02:42 user nova-compute[71206]: </domain>
Jul 27 18:02:42 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-337632116',display_name='tempest-TestServerVolumeAttachmentScenario-server-337632116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-337632116',id=15,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vHmZugU3Oma8fLl/VXIn7mQqwQ3VqyVUIRDT2vHEWq4bTGSA+0jwNBdhFULKEbdyIgmAuzHC7+31T5MxX40tc5RSLWqT/Mxx7dPDqV0QD3gFRjejMOzxBsarCjBe9BQ==',key_name='tempest-keypair-1414437643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83d3c8a7014948aaa46fde6a6c6fd623',ramdisk_id='',reservation_id='r-eeuurb4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-836302792',owner_user_name='tempest-TestServerVolumeAttachmentScenario-836302792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d54156d44349cbb9e2076cf2799bd0',uuid=764b00ce-48cb-472a-9bcd-0546f6cf3c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converting VIF {"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG os_vif [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2253410a-aa, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2253410a-aa, col_values=(('external_ids', {'iface-id': '2253410a-aa7f-409b-9519-32fcdf1f3bf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:4c:d7', 'vm-uuid': '764b00ce-48cb-472a-9bcd-0546f6cf3c4c'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:42 user nova-compute[71206]: INFO os_vif [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa')
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No VIF found with MAC fa:16:3e:77:4c:d7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updated VIF entry in instance network info cache for port 2253410a-aa7f-409b-9519-32fcdf1f3bf4. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:02:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating instance_info_cache with network_info: [{"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:02:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-13e2af8a-33bd-4d42-b6a4-f85a1080f6eb req-e31d7fbb-5b03-4d49-bf81-5bdcd115e3fc service nova] Releasing lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:02:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] No waiting events found dispatching network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:44 user nova-compute[71206]: WARNING nova.compute.manager [req-037938fc-454a-4581-87a2-270c0414bf29 req-a2ab1c58-86af-4dc9-b9e0-f777acb6806e service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received unexpected event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 for instance with vm_state building and task_state spawning.
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480966.3356712, 764b00ce-48cb-472a-9bcd-0546f6cf3c4c => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] VM Resumed (Lifecycle Event)
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Instance spawned successfully.
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480966.3407216, 764b00ce-48cb-472a-9bcd-0546f6cf3c4c => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] VM Started (Lifecycle Event)
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Took 5.69 seconds to spawn the instance on the hypervisor.
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:46 user nova-compute[71206]: INFO nova.compute.manager [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Took 6.59 seconds to build instance.
Jul 27 18:02:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-88a1c04d-5b00-466c-a1aa-a763c571afab tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.698s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] No waiting events found dispatching network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:46 user nova-compute[71206]: WARNING nova.compute.manager [req-14c12ced-0710-4fc0-9b83-1ffe5e4df7e5 req-d3f37a13-cf6a-43d2-ac3c-170b4140f6cd service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received unexpected event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 for instance with vm_state active and task_state None.
Jul 27 18:02:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:02:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Creating image(s)
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Ensure instance console log exists: /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start _get_guest_xml network_info=[{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '6f5fbfde-645d-4ac0-8e93-45d26a20e705', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3564a8f7-d3c6-4a44-a8e0-05e6123987e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd15f2530-b185-42cc-a3c9-d10b3cb919ae', 'serial': 'd15f2530-b185-42cc-a3c9-d10b3cb919ae'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:02:47 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:47 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:02:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:02:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:02:48 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54e5de-b3c6-4966-ab2b-e216c0c3efbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:02:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd98e70-049a-45bd-8cf0-80363c53846c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae] added
Jul 27 18:02:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba177f6c-b72c-4674-b257-d6b958d93a87]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa52f8c-4f61-4b2c-bde0-bee163d694cb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smagXquQ {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smagXquQ" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1629799-7052-4ed9-83d1-c8d554e3ade8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smagXquQ'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fd0a7-25c5-40b7-ae9f-77dd6b63b205]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2ea34-2e39-42c9-9fa7-f356f56606ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:02:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:02:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:02:48 user nova-compute[71206]: 
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4a725-f751-4276-87a0-951bb7a83552]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260]
Jul 27 18:02:48 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260] successful.
Jul 27 18:02:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e5f48-d519-445c-913e-e700f2af7729]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c517a61c-615e-4193-853c-7a70ab0a02e5]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:02:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:02:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eecaf6d-9400-425e-b7ba-358d2966acc7]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:02:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23565383363396235', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565383363396235', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778864700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778864700',id=14,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6cm75eep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:35Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=3564a8f7-d3c6-4a44-a8e0-05e6123987e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:02:49 user nova-compute[71206]:   <uuid>3564a8f7-d3c6-4a44-a8e0-05e6123987e5</uuid>
Jul 27 18:02:49 user nova-compute[71206]:   <name>instance-0000000e</name>
Jul 27 18:02:49 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:02:49 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:02:49 user nova-compute[71206]:   <metadata>
Jul 27 18:02:49 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:02:49 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-778864700</nova:name>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:02:47</nova:creationTime>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:02:49 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:02:49 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:owner>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 18:02:49 user nova-compute[71206]:       </nova:owner>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:02:49 user nova-compute[71206]:       <nova:ports>
Jul 27 18:02:49 user nova-compute[71206]:         <nova:port uuid="2da326ce-e53a-43c4-9cf5-0ba3bab0527d">
Jul 27 18:02:49 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 18:02:49 user nova-compute[71206]:         </nova:port>
Jul 27 18:02:49 user nova-compute[71206]:       </nova:ports>
Jul 27 18:02:49 user nova-compute[71206]:     </nova:instance>
Jul 27 18:02:49 user nova-compute[71206]:   </metadata>
Jul 27 18:02:49 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:02:49 user nova-compute[71206]:     <system>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="serial">3564a8f7-d3c6-4a44-a8e0-05e6123987e5</entry>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="uuid">3564a8f7-d3c6-4a44-a8e0-05e6123987e5</entry>
Jul 27 18:02:49 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:02:49 user nova-compute[71206]:     </system>
Jul 27 18:02:49 user nova-compute[71206]:   </sysinfo>
Jul 27 18:02:49 user nova-compute[71206]:   <os>
Jul 27 18:02:49 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:02:49 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:02:49 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:02:49 user nova-compute[71206]:   </os>
Jul 27 18:02:49 user nova-compute[71206]:   <features>
Jul 27 18:02:49 user nova-compute[71206]:     <acpi/>
Jul 27 18:02:49 user nova-compute[71206]:     <apic/>
Jul 27 18:02:49 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:02:49 user nova-compute[71206]:   </features>
Jul 27 18:02:49 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:02:49 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:02:49 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:02:49 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:02:49 user nova-compute[71206]:   </clock>
Jul 27 18:02:49 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:02:49 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:02:49 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:02:49 user nova-compute[71206]:   </cpu>
Jul 27 18:02:49 user nova-compute[71206]:   <devices>
Jul 27 18:02:49 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:02:49 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:02:49 user nova-compute[71206]:       <source dev="/dev/sdb"/>
Jul 27 18:02:49 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:02:49 user nova-compute[71206]:       <serial>d15f2530-b185-42cc-a3c9-d10b3cb919ae</serial>
Jul 27 18:02:49 user nova-compute[71206]:     </disk>
Jul 27 18:02:49 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:02:49 user nova-compute[71206]:       <mac address="fa:16:3e:18:ed:63"/>
Jul 27 18:02:49 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:02:49 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:02:49 user nova-compute[71206]:       <target dev="tap2da326ce-e5"/>
Jul 27 18:02:49 user nova-compute[71206]:     </interface>
Jul 27 18:02:49 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:02:49 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/console.log" append="off"/>
Jul 27 18:02:49 user nova-compute[71206]:     </serial>
Jul 27 18:02:49 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:02:49 user nova-compute[71206]:     <video>
Jul 27 18:02:49 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:02:49 user nova-compute[71206]:     </video>
Jul 27 18:02:49 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:02:49 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:02:49 user nova-compute[71206]:     </rng>
Jul 27 18:02:49 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:02:49 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:02:49 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:02:49 user nova-compute[71206]:     </memballoon>
Jul 27 18:02:49 user nova-compute[71206]:   </devices>
Jul 27 18:02:49 user nova-compute[71206]: </domain>
Jul 27 18:02:49 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778864700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778864700',id=14,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6cm75eep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:35Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=3564a8f7-d3c6-4a44-a8e0-05e6123987e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG os_vif [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2da326ce-e5, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2da326ce-e5, col_values=(('external_ids', {'iface-id': '2da326ce-e53a-43c4-9cf5-0ba3bab0527d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:ed:63', 'vm-uuid': '3564a8f7-d3c6-4a44-a8e0-05e6123987e5'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:49 user nova-compute[71206]: INFO os_vif [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5')
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:02:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:18:ed:63, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:02:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:51 user nova-compute[71206]: WARNING nova.compute.manager [req-9912bd68-2fc3-49f8-81ce-ce0344309548 req-34d5cb40-a741-4627-9703-2cd6c4a9f0a9 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state building and task_state spawning.
Jul 27 18:02:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480973.0033827, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Resumed (Lifecycle Event)
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance spawned successfully.
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480973.0036514, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Started (Lifecycle Event)
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:02:53 user nova-compute[71206]: WARNING nova.compute.manager [req-faf31729-384c-4057-bcd5-df5d86ab1cc7 req-5588ea65-a02f-4a9c-9e98-edfca6d8a807 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state building and task_state spawning.
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Took 5.19 seconds to spawn the instance on the hypervisor.
Jul 27 18:02:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:02:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:53 user nova-compute[71206]: INFO nova.compute.manager [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Took 19.62 seconds to build instance.
Jul 27 18:02:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0bb0d632-c6f5-49ff-aa63-cd124c9b5363 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.733s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:02:57 user nova-compute[71206]: INFO nova.compute.claims [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Claim successful on node user
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:02:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:02:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.policy [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '204444b73ce844fd9514fcc031569ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a4baf2bde924071b61112ce65124c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:02:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Creating image(s)
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "/opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "/opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk 1073741824" returned: 0 in 0.090s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Cannot resize image /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.objects.instance [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'migration_context' on Instance uuid 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Ensure instance console log exists: /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:02:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Successfully created port: 21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Successfully updated port: 21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquired lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-changed-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Refreshing instance network info cache due to event network-changed-21646dd0-1c73-4b3a-96be-e94533074893. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] Acquiring lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:02:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:00 user nova-compute[71206]: INFO nova.compute.manager [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Terminating instance
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Updating instance_info_cache with network_info: [{"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Releasing lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Instance network_info: |[{"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] Acquired lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Refreshing network info cache for port 21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Start _get_guest_xml network_info=[{"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:03:00 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:00 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-154227508',display_name='tempest-VolumesAdminNegativeTest-server-154227508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-154227508',id=16,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-xjq0yxkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:58Z,user_data=None,user_id='204444b73ce844fd9514fcc031569ae4',uuid=1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.objects.instance [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:03:00 user nova-compute[71206]:   <uuid>1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b</uuid>
Jul 27 18:03:00 user nova-compute[71206]:   <name>instance-00000010</name>
Jul 27 18:03:00 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:03:00 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:03:00 user nova-compute[71206]:   <metadata>
Jul 27 18:03:00 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:03:00 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:name>tempest-VolumesAdminNegativeTest-server-154227508</nova:name>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:03:00</nova:creationTime>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:03:00 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:03:00 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:owner>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:user uuid="204444b73ce844fd9514fcc031569ae4">tempest-VolumesAdminNegativeTest-426544505-project-member</nova:user>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:project uuid="0a4baf2bde924071b61112ce65124c1e">tempest-VolumesAdminNegativeTest-426544505</nova:project>
Jul 27 18:03:00 user nova-compute[71206]:       </nova:owner>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:03:00 user nova-compute[71206]:       <nova:ports>
Jul 27 18:03:00 user nova-compute[71206]:         <nova:port uuid="21646dd0-1c73-4b3a-96be-e94533074893">
Jul 27 18:03:00 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:03:00 user nova-compute[71206]:         </nova:port>
Jul 27 18:03:00 user nova-compute[71206]:       </nova:ports>
Jul 27 18:03:00 user nova-compute[71206]:     </nova:instance>
Jul 27 18:03:00 user nova-compute[71206]:   </metadata>
Jul 27 18:03:00 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:03:00 user nova-compute[71206]:     <system>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="serial">1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b</entry>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="uuid">1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b</entry>
Jul 27 18:03:00 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:03:00 user nova-compute[71206]:     </system>
Jul 27 18:03:00 user nova-compute[71206]:   </sysinfo>
Jul 27 18:03:00 user nova-compute[71206]:   <os>
Jul 27 18:03:00 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:03:00 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:03:00 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:03:00 user nova-compute[71206]:   </os>
Jul 27 18:03:00 user nova-compute[71206]:   <features>
Jul 27 18:03:00 user nova-compute[71206]:     <acpi/>
Jul 27 18:03:00 user nova-compute[71206]:     <apic/>
Jul 27 18:03:00 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:03:00 user nova-compute[71206]:   </features>
Jul 27 18:03:00 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:03:00 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:03:00 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:03:00 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:03:00 user nova-compute[71206]:   </clock>
Jul 27 18:03:00 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:03:00 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:03:00 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:03:00 user nova-compute[71206]:   </cpu>
Jul 27 18:03:00 user nova-compute[71206]:   <devices>
Jul 27 18:03:00 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:00 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:00 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk"/>
Jul 27 18:03:00 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:03:00 user nova-compute[71206]:     </disk>
Jul 27 18:03:00 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:03:00 user nova-compute[71206]:       <mac address="fa:16:3e:2d:0b:28"/>
Jul 27 18:03:00 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:00 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:03:00 user nova-compute[71206]:       <target dev="tap21646dd0-1c"/>
Jul 27 18:03:00 user nova-compute[71206]:     </interface>
Jul 27 18:03:00 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:03:00 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/console.log" append="off"/>
Jul 27 18:03:00 user nova-compute[71206]:     </serial>
Jul 27 18:03:00 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:03:00 user nova-compute[71206]:     <video>
Jul 27 18:03:00 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:00 user nova-compute[71206]:     </video>
Jul 27 18:03:00 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:03:00 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:03:00 user nova-compute[71206]:     </rng>
Jul 27 18:03:00 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:03:00 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:03:00 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:03:00 user nova-compute[71206]:     </memballoon>
Jul 27 18:03:00 user nova-compute[71206]:   </devices>
Jul 27 18:03:00 user nova-compute[71206]: </domain>
Jul 27 18:03:00 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-154227508',display_name='tempest-VolumesAdminNegativeTest-server-154227508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-154227508',id=16,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-xjq0yxkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:58Z,user_data=None,user_id='204444b73ce844fd9514fcc031569ae4',uuid=1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG os_vif [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21646dd0-1c, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21646dd0-1c, col_values=(('external_ids', {'iface-id': '21646dd0-1c73-4b3a-96be-e94533074893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:0b:28', 'vm-uuid': '1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: INFO os_vif [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c')
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-unplugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-unplugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b0fda65-c8b6-40ce-9238-169df81c31fe req-556676b1-121e-43dd-bf90-939b565b20eb service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-unplugged-2846403b-4b4b-45d6-913f-aca6ec36385e for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] No VIF found with MAC fa:16:3e:2d:0b:28, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Instance destroyed successfully.
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.objects.instance [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lazy-loading 'resources' on Instance uuid 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-604937323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-604937323',id=9,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN98PQqSMJcwJF9v4VlD6d/ty8F/dpO9rXU+DHeM0BtHP5pP+x0SU+6sLievvUFf4AZUmPkzCkPMIG/oH67GMemOqzL7TctLKWx2e3R4syjR0akF5C9jgr+4f7Ydp9/Z3Q==',key_name='tempest-keypair-131878090',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='679da984d9634ff18a2af5f57475a990',ramdisk_id='',reservation_id='r-0nfwxlvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-206507824',owner_user_name='tempest-TaggedAttachmentsTest-206507824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='411afe8aa87048debd9703a1b141eb01',uuid=94791cd9-cfbb-4d07-82f0-3cbfaaacbf13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converting VIF {"id": "2846403b-4b4b-45d6-913f-aca6ec36385e", "address": "fa:16:3e:57:be:a8", "network": {"id": "88c2bdf5-5127-4c69-bb11-fcc4782a6cee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1359902962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "679da984d9634ff18a2af5f57475a990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2846403b-4b", "ovs_interfaceid": "2846403b-4b4b-45d6-913f-aca6ec36385e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG os_vif [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2846403b-4b, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:00 user nova-compute[71206]: INFO os_vif [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=2846403b-4b4b-45d6-913f-aca6ec36385e,network=Network(88c2bdf5-5127-4c69-bb11-fcc4782a6cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2846403b-4b')
Jul 27 18:03:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Deleting instance files /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13_del
Jul 27 18:03:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Deletion of /opt/stack/data/nova/instances/94791cd9-cfbb-4d07-82f0-3cbfaaacbf13_del complete
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Updated VIF entry in instance network info cache for port 21646dd0-1c73-4b3a-96be-e94533074893. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Updating instance_info_cache with network_info: [{"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-72274b38-377b-4a35-8f2c-770adb325f89 req-69294611-3d32-4053-a9bc-26a2541c46f5 service nova] Releasing lock "refresh_cache-1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:00 user nova-compute[71206]: INFO nova.compute.manager [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 18:03:00 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:03:00 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:03:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:01 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:01 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Took 0.82 seconds to deallocate network for instance.
Jul 27 18:03:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-a9c77801-ffa0-41b1-b2f7-5f1069f0ccdd req-95cb7be1-6856-4e05-be00-60bb30f4f268 service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-deleted-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:02 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Deleted allocations for instance 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13
Jul 27 18:03:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-08a41b67-5ff0-4553-8c3e-7a3c593e6712 tempest-TaggedAttachmentsTest-206507824 tempest-TaggedAttachmentsTest-206507824-project-member] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] Acquiring lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] Lock "94791cd9-cfbb-4d07-82f0-3cbfaaacbf13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] No waiting events found dispatching network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:02 user nova-compute[71206]: WARNING nova.compute.manager [req-527a917a-0bfc-46cf-b63f-34f1df832a2b req-a1a9b9da-6664-4554-bacc-8eb96cee5f1e service nova] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Received unexpected event network-vif-plugged-2846403b-4b4b-45d6-913f-aca6ec36385e for instance with vm_state deleted and task_state None.
Jul 27 18:03:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] No waiting events found dispatching network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:04 user nova-compute[71206]: WARNING nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received unexpected event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 for instance with vm_state building and task_state spawning.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] No waiting events found dispatching network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:04 user nova-compute[71206]: WARNING nova.compute.manager [req-c8b608a0-d224-4acb-9ffa-8a329c3e1f78 req-d8bd7672-d146-44bf-8914-efdb2fc91123 service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received unexpected event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 for instance with vm_state building and task_state spawning.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480984.260758, 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] VM Resumed (Lifecycle Event)
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Instance spawned successfully.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690480984.264391, 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] VM Started (Lifecycle Event)
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Took 6.26 seconds to spawn the instance on the hypervisor.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:04 user nova-compute[71206]: INFO nova.compute.manager [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Took 7.18 seconds to build instance.
Jul 27 18:03:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-615b5c94-28f4-42db-a087-56b8f7b7cf23 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:13 user nova-compute[71206]: INFO nova.compute.manager [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Terminating instance
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-unplugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] No waiting events found dispatching network-vif-unplugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-01c08b84-7bb5-4df2-a312-ffb28065467c req-b12b1782-544d-44af-8e76-3cdc9da38828 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-unplugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Instance destroyed successfully.
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'resources' on Instance uuid a9eaffca-4af0-4208-95be-2894eec95276 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2123453327',display_name='tempest-ServersNegativeTestJSON-server-2123453327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2123453327',id=13,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-zfu9ifa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:01:37Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=a9eaffca-4af0-4208-95be-2894eec95276,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "address": "fa:16:3e:93:cc:4b", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap524f882c-25", "ovs_interfaceid": "524f882c-25b7-4ab0-b120-ad47d70e0b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG os_vif [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap524f882c-25, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:13 user nova-compute[71206]: INFO os_vif [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cc:4b,bridge_name='br-int',has_traffic_filtering=True,id=524f882c-25b7-4ab0-b120-ad47d70e0b47,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap524f882c-25')
Jul 27 18:03:13 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Deleting instance files /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276_del
Jul 27 18:03:13 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Deletion of /opt/stack/data/nova/instances/a9eaffca-4af0-4208-95be-2894eec95276_del complete
Jul 27 18:03:13 user nova-compute[71206]: INFO nova.compute.manager [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Took 0.77 seconds to destroy the instance on the hypervisor.
Jul 27 18:03:13 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:03:13 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:03:14 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:14 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Took 0.64 seconds to deallocate network for instance.
Jul 27 18:03:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-04128ded-00fa-487d-8a60-a6ddc7a02e9a req-1a222b0f-c9e4-43bd-85ae-4cca37a8b1b1 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-deleted-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:15 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Deleted allocations for instance a9eaffca-4af0-4208-95be-2894eec95276
Jul 27 18:03:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a9637d1d-077c-45e1-bd16-51258912406a tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "a9eaffca-4af0-4208-95be-2894eec95276" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] Acquiring lock "a9eaffca-4af0-4208-95be-2894eec95276-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] Lock "a9eaffca-4af0-4208-95be-2894eec95276-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] No waiting events found dispatching network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:15 user nova-compute[71206]: WARNING nova.compute.manager [req-3fbf9a85-4d5b-40be-82e2-7cfc441fbd3e req-75bd5cbe-f247-4c7f-8ee7-5b8482aa3595 service nova] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Received unexpected event network-vif-plugged-524f882c-25b7-4ab0-b120-ad47d70e0b47 for instance with vm_state deleted and task_state None.
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690480980.8570414, 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:15 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] VM Stopped (Lifecycle Event)
Jul 27 18:03:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-c2beeeae-33d1-4658-bf6f-261ef2ad0bd7 None None] [instance: 94791cd9-cfbb-4d07-82f0-3cbfaaacbf13] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:03:21 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:03:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'flavor' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:24 user nova-compute[71206]: INFO nova.compute.manager [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Attaching volume 68e5616e-97d1-4041-ab14-67fbed459212 to /dev/vdb
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7cfe0-bec3-46c5-aa4c-93e0396d8dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fac0a5-69c9-4853-b25a-74598b2a94b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0e2cf-d935-43d1-87aa-611fbc1bde01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cba742-a11e-4437-99fc-971679189ef1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:24 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad804bdf-e112-4879-8f72-a5d048546bcc]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating existing volume attachment record: bc64b579-971b-4cc2-aafc-a0357e7dbc42 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'flavor' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:25 user nova-compute[71206]: INFO nova.compute.manager [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attaching volume 2205aa9d-fc29-4da9-acc6-fd052174e42c to /dev/vdb
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a92a44-b8c0-4df0-b6f7-173ca2f71b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa5f95c-f1e0-41f0-8daf-fd1bbadfc1c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b5e88-73a7-46f1-98e4-69ca6aea018e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30a8b2-b1ec-4e0f-b4f1-3a7b95731e81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:25 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f71d52-c042-42fa-b990-7d9fad8d6fa0]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating existing volume attachment record: a87b9d6f-a84c-43ed-bafd-ecf68328f725 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:26 user nova-compute[71206]: INFO nova.compute.manager [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Unshelving
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: INFO nova.virt.block_device [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Booting with volume f7102fdf-2983-4c96-ab34-ccf98fd7903d at /dev/vdc
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.utils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e28243-38fe-47dc-9dbb-359f340fddf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6afc6b-c4f0-498c-a5e8-9aa0b941465a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dcdb41-abab-4e9a-b0a1-e9ec205c160f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3ecd14-3ed6-4d11-af56-191712f15b00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:26 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e03d631-7327-49f5-9903-7d08f3ab6017]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG os_brick.utils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating existing volume attachment record: 99f61e72-6739-47a4-9698-e0b30b64051a {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.398s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690480993.823531, a9eaffca-4af0-4208-95be-2894eec95276 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:28 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a9eaffca-4af0-4208-95be-2894eec95276] VM Stopped (Lifecycle Event)
Jul 27 18:03:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:28 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7203MB free_disk=25.574203491210938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-17cade1c-9493-4c32-b0ad-31cda4266883 None None] [instance: a9eaffca-4af0-4208-95be-2894eec95276] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d1c93904-5854-4093-a782-58723eb98bb9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1735}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:03:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:33 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:33 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:33 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ba93a8-98f0-424d-9ad9-fefef457762e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:03:33 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e790974-ad43-42f6-b6fd-ed78e819ffe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c] added
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b5d741-71f5-40f0-b26e-8c3431e5f4ef]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a543ba9-b329-46e4-8556-f7b2b08a307e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrphtesF {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:33 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrphtesF" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d42f3-8e4e-4924-9804-8af3f0f59c50]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrphtesF'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3110488e-18a8-4bf5-b57e-98aa05cdac9e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61748761-cc7b-4338-aec9-462212637609]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717cdf0-48a8-4482-939e-a96de6fce933]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260]
Jul 27 18:03:33 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260] successful.
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c4c4b-750c-4108-8894-f028eb8f5d4c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3842515d-64f2-4cd8-bbe8-d57e3a29e406]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:33 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:33 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6255497-4e37-4b69-a3f7-ad32171158e9]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:33 user nova-compute[71206]: INFO nova.compute.manager [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Terminating instance
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-unplugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] No waiting events found dispatching network-vif-unplugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f738467d-7a21-4999-b314-19a51685d536 req-45ea8724-9b6a-4e27-b220-512e4668e5f9 service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-unplugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:03:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Instance destroyed successfully.
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lazy-loading 'resources' on Instance uuid 24390c1b-61e1-4a56-92ae-cd7b79e67da6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1554878388',display_name='tempest-TestVolumeSwap-server-1554878388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1554878388',id=11,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIykvBP6jheYFTgbyMZ5unJLexq4JcgD4v189y5h0/HdrBFIofPX1ndIvTtz2QIZtqVcoUw9OSSbVr1c/YRute8WDFy9SByZh1MNXN9RAXVgq669Ggoffho7SDFb9ylr6w==',key_name='tempest-keypair-933434411',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cd5677e4fd84943a4ddd1ae7c1e737a',ramdisk_id='',reservation_id='r-gusrkjpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-386645751',owner_user_name='tempest-TestVolumeSwap-386645751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825130825ff442898bc4783be5a45a43',uuid=24390c1b-61e1-4a56-92ae-cd7b79e67da6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converting VIF {"id": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "address": "fa:16:3e:b4:ea:41", "network": {"id": "72bab66a-fd3d-448e-8e2b-9c936e2687ae", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378295028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cd5677e4fd84943a4ddd1ae7c1e737a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap107fcac0-82", "ovs_interfaceid": "107fcac0-825a-4a40-a7fa-c5a1ae4a5965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_vif [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap107fcac0-82, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:34 user nova-compute[71206]: INFO os_vif [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965,network=Network(72bab66a-fd3d-448e-8e2b-9c936e2687ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap107fcac0-82')
Jul 27 18:03:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Deleting instance files /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6_del
Jul 27 18:03:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Deletion of /opt/stack/data/nova/instances/24390c1b-61e1-4a56-92ae-cd7b79e67da6_del complete
Jul 27 18:03:34 user nova-compute[71206]: INFO nova.compute.manager [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23835303230373932', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835303230373932', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.269s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:34 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:34 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'flavor' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb9ce0-d79d-46a4-b26c-916e2a2903fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:03:34 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:03:34 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:03:34 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:03:34 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:03:34 user nova-compute[71206]:   <serial>2205aa9d-fc29-4da9-acc6-fd052174e42c</serial>
Jul 27 18:03:34 user nova-compute[71206]: </disk>
Jul 27 18:03:34 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a9118-1d28-429e-bd6d-b1650ebe3805]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7137367-e8de-4d8c-97d1-ed05a50e8a3c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b862045-7282-40f3-a806-bd2f7c7e7eb9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da806f5-6268-4949-9fc4-7eadd9115e0a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXbRKtDm'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2faa3-aee0-40e9-bb10-1fe582a8ad29]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35528f-b86d-45a6-b254-3a291808bdcc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cef943d-5d26-46d8-9cc3-221ba71baee8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:03:34 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf37c75-7ab8-4bcf-adeb-f05fd7c309c7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bca430-9b4a-4fee-9a69-253fc7bcbaf8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f69d6-41ef-4f2d-bd71-c06a2d57a45d]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_requests' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'numa_topology' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:03:34 user nova-compute[71206]: INFO nova.compute.claims [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Claim successful on node user
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No VIF found with MAC fa:16:3e:ae:41:5b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-809e8e6a-bcbe-48d8-8372-f38d2fb6c98f tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.920s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:35 user nova-compute[71206]: INFO nova.network.neutron [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating port a7201185-dc60-491f-852e-03df17fcb1bd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== connect_volume: return (2675ms) {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.objects.instance [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'flavor' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:03:35 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:03:35 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:03:35 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:03:35 user nova-compute[71206]:   <serial>68e5616e-97d1-4041-ab14-67fbed459212</serial>
Jul 27 18:03:35 user nova-compute[71206]: </disk>
Jul 27 18:03:35 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:35 user nova-compute[71206]: INFO nova.compute.manager [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Rescuing
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-16b55f8a-0711-4ac8-96b3-c6e86a885c0d req-32404952-2055-468c-aff1-acdc43b9775c service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-deleted-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:35 user nova-compute[71206]: INFO nova.compute.manager [req-16b55f8a-0711-4ac8-96b3-c6e86a885c0d req-32404952-2055-468c-aff1-acdc43b9775c service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Neutron deleted interface 107fcac0-825a-4a40-a7fa-c5a1ae4a5965; detaching it from the instance and deleting it from the info cache
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.network.neutron [req-16b55f8a-0711-4ac8-96b3-c6e86a885c0d req-32404952-2055-468c-aff1-acdc43b9775c service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:35 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Took 1.55 seconds to deallocate network for instance.
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-16b55f8a-0711-4ac8-96b3-c6e86a885c0d req-32404952-2055-468c-aff1-acdc43b9775c service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Detach interface failed, port_id=107fcac0-825a-4a40-a7fa-c5a1ae4a5965, reason: Instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] Acquiring lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] No waiting events found dispatching network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:35 user nova-compute[71206]: WARNING nova.compute.manager [req-92c56202-c1f8-4779-b9af-8b0c55f07a74 req-9abc82cc-d08a-4e62-8590-c436c1dbf2ee service nova] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Received unexpected event network-vif-plugged-107fcac0-825a-4a40-a7fa-c5a1ae4a5965 for instance with vm_state active and task_state deleting.
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No VIF found with MAC fa:16:3e:16:b7:4b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-03dd32d9-bae5-4921-9d0e-e67d0b832263 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.545s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:36 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Deleted allocations for instance 24390c1b-61e1-4a56-92ae-cd7b79e67da6
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cace0834-b45e-484c-8429-998288c5cd81 tempest-TestVolumeSwap-386645751 tempest-TestVolumeSwap-386645751-project-member] Lock "24390c1b-61e1-4a56-92ae-cd7b79e67da6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG nova.network.neutron [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance destroyed successfully.
Jul 27 18:03:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attempting a stable device rescue
Jul 27 18:03:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:03:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Creating image(s)
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing instance network info cache due to event network-changed-a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:38 user nova-compute[71206]: WARNING nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:38 user nova-compute[71206]: WARNING nova.compute.manager [req-6646ce31-e3d2-4b46-8a7c-3c43d5738508 req-69b04ad6-e30e-41b2-b1fe-372e8c98eb92 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:39 user nova-compute[71206]: DEBUG nova.virt.images [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] 0d8a7f94-75ed-443c-b816-1d99d3d25089 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:03:39 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:03:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.part /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:03:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Creating image(s)
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.network.neutron [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Refreshing network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "252cdbe45f9d27437ae676efb127282c43ceb9da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "252cdbe45f9d27437ae676efb127282c43ceb9da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.part /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.converted" returned: 0 in 0.422s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:40 user nova-compute[71206]: WARNING nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:40 user nova-compute[71206]: WARNING nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:40 user nova-compute[71206]: WARNING nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:40 user nova-compute[71206]: WARNING nova.compute.manager [req-1649b448-a9be-4ff6-b542-e9b7a745a1d4 req-157dbd5d-8874-4746-b03e-0c6b1fe7d920 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c.converted --force-share --output=json" returned: 0 in 0.923s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.088s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Stashing vm_state: active {{(pid=71206) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.images [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] b1bb403e-071d-4aac-9585-3a57cb9dea94 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.part /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c --force-share --output=json" returned: 0 in 0.164s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c,backing_fmt=raw /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'pci_requests' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c,backing_fmt=raw /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue" returned: 0 in 0.066s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "5113ffe47beb05d7e4fd0142fd0fc36a9eae459c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'migration_context' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:03:41 user nova-compute[71206]: INFO nova.compute.claims [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Claim successful on node user
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'resources' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.part /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.converted" returned: 0 in 0.201s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start _get_guest_xml network_info=[{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "vif_mac": "fa:16:3e:ae:41:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d8a7f94-75ed-443c-b816-1d99d3d25089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'a87b9d6f-a84c-43ed-bafd-ecf68328f725', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '71cb36ca-6721-4882-b30d-68ae8189e0c6', 'attached_at': '', 'detached_at': '', 'volume_id': '2205aa9d-fc29-4da9-acc6-fd052174e42c', 'serial': '2205aa9d-fc29-4da9-acc6-fd052174e42c'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'resources' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'numa_topology' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'pci_devices' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating resource usage from migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:41 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:41 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:41 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "252cdbe45f9d27437ae676efb127282c43ceb9da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.487s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa49e4-5b7d-438b-9c44-d6dea8a27bad]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KrphtesF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 18:03:41 user nova-compute[71206]: node.name = iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:03:41 user nova-compute[71206]: node.tpgt = -1
Jul 27 18:03:41 user nova-compute[71206]: node.startup = automatic
Jul 27 18:03:41 user nova-compute[71206]: node.leading_login = No
Jul 27 18:03:41 user nova-compute[71206]: iface.iscsi_ifacename = default
Jul 27 18:03:41 user nova-compute[71206]: iface.net_ifacename = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.ipaddress = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.prefix_len = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.hwaddress = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.transport_name = tcp
Jul 27 18:03:41 user nova-compute[71206]: iface.initiatorname = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.vlan_id = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.vlan_priority = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.vlan_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.iface_num = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.mtu = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.port = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.bootproto = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.subnet_mask = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.gateway = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_alt_client_id = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_dns = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_learn_iqn = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_vendor_id_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_vendor_id = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.dhcp_slp_da = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.fragmentation = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.gratuitous_arp = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.incoming_forwarding = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.tos_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.tos = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.ttl = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.delayed_ack = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.tcp_nagle = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.tcp_wsf_state = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.tcp_wsf = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.tcp_timer_scale = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.tcp_timestamp = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.redirect = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.def_task_mgmt_timeout = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.header_digest = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.data_digest = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.immediate_data = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.initial_r2t = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.data_seq_inorder = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.data_pdu_inorder = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.erl = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.max_receive_data_len = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.first_burst_len = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.max_outstanding_r2t = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.max_burst_len = 0
Jul 27 18:03:41 user nova-compute[71206]: iface.chap_auth = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.bidi_chap = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.strict_login_compliance = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.discovery_auth = <empty>
Jul 27 18:03:41 user nova-compute[71206]: iface.discovery_logout = <empty>
Jul 27 18:03:41 user nova-compute[71206]: node.discovery_address = <empty>
Jul 27 18:03:41 user nova-compute[71206]: node.discovery_port = 0
Jul 27 18:03:41 user nova-compute[71206]: node.discovery_type = static
Jul 27 18:03:41 user nova-compute[71206]: node.session.initial_cmdsn = 0
Jul 27 18:03:41 user nova-compute[71206]: node.session.initial_login_retry_max = 8
Jul 27 18:03:41 user nova-compute[71206]: node.session.xmit_thread_priority = -20
Jul 27 18:03:41 user nova-compute[71206]: node.session.cmds_max = 128
Jul 27 18:03:41 user nova-compute[71206]: node.session.queue_depth = 32
Jul 27 18:03:41 user nova-compute[71206]: node.session.nr_sessions = 1
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.authmethod = CHAP
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.username = KrphtesF
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.password = ***
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.username_in = <empty>
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.password_in = <empty>
Jul 27 18:03:41 user nova-compute[71206]: node.session.auth.chap_algs = MD5
Jul 27 18:03:41 user nova-compute[71206]: node.session.timeo.replacement_timeout = 120
Jul 27 18:03:41 user nova-compute[71206]: node.session.err_timeo.abort_timeout = 15
Jul 27 18:03:41 user nova-compute[71206]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 18:03:41 user nova-compute[71206]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 18:03:41 user nova-compute[71206]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.FastAbort = Yes
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.InitialR2T = No
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.ImmediateData = Yes
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.MaxConnections = 1
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 18:03:41 user nova-compute[71206]: node.session.iscsi.ERL = 0
Jul 27 18:03:41 user nova-compute[71206]: node.session.scan = manual
Jul 27 18:03:41 user nova-compute[71206]: node.session.reopen_max = 0
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].address = 172.16.0.220
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].port = 3260
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].startup = manual
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].tcp.window_size = 524288
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].tcp.type_of_service = 0
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].timeo.logout_timeout = 15
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].timeo.login_timeout = 15
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].timeo.auth_timeout = 45
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.DataDigest = None
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.IFMarker = No
Jul 27 18:03:41 user nova-compute[71206]: node.conn[0].iscsi.OFMarker = No
Jul 27 18:03:41 user nova-compute[71206]: # END RECORD
Jul 27 18:03:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0b256-b237-4b21-a450-07760bc205db]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49a147-d6f2-4354-aca8-6a1f96d380e9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrphtesF {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.network.neutron [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updated VIF entry in instance network info cache for port a7201185-dc60-491f-852e-03df17fcb1bd. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.network.neutron [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrphtesF" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0cc32f-97db-4aa1-bfe4-490d88e56be6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrphtesF'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "252cdbe45f9d27437ae676efb127282c43ceb9da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "252cdbe45f9d27437ae676efb127282c43ceb9da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb304bd-f0a2-46cd-a0d9-728fa64bf6c1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1a483064-97d2-4569-8519-b9395adbf6ed req-0d59a260-36c7-47a6-a5b2-af19d82dce88 service nova] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95078ddc-55b8-42fd-954f-15fb73fdf4d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:41 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:41 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:41 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:41 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] HCTL ('34', '0', '0', 0) found on session 10 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c101cdd-7340-4750-9020-1fd8556b4733]: (4, ('0 0 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Searching for a device in session 10 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.291s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] <== connect_volume: return (293ms) {'type': 'block', 'scsi_wwn': '23835303230373932', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835303230373932', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da,backing_fmt=raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2072367951',display_name='tempest-ServerStableDeviceRescueTest-server-2072367951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2072367951',id=7,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHt6bkycVjKTXxU0uQQUQLsipCybbo5tqpxXIbkmbqimQuV0ZXzMkXaJPa2UkZk+4IB6PDVpRs5r/GPVH50Ktgikwnozo0rO81mXFRR2f2q/WxryWWYYhwq5m//GEqM8A==',key_name='tempest-keypair-71631035',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9d3feea7c4d069de51b33ff29ce4b',ramdisk_id='',reservation_id='r-tbob8kt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1738306522',owner_user_name='tempest-ServerStableDeviceRescueTest-1738306522-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e118a0a4fcb49b185eb68e74988195f',uuid=71cb36ca-6721-4882-b30d-68ae8189e0c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "vif_mac": "fa:16:3e:ae:41:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converting VIF {"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "vif_mac": "fa:16:3e:ae:41:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'pci_devices' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da,backing_fmt=raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk 1073741824" returned: 0 in 0.087s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "252cdbe45f9d27437ae676efb127282c43ceb9da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:03:42 user nova-compute[71206]:   <uuid>71cb36ca-6721-4882-b30d-68ae8189e0c6</uuid>
Jul 27 18:03:42 user nova-compute[71206]:   <name>instance-00000007</name>
Jul 27 18:03:42 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:03:42 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:03:42 user nova-compute[71206]:   <metadata>
Jul 27 18:03:42 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:03:42 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2072367951</nova:name>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:03:41</nova:creationTime>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:03:42 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:03:42 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:owner>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:user uuid="2e118a0a4fcb49b185eb68e74988195f">tempest-ServerStableDeviceRescueTest-1738306522-project-member</nova:user>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:project uuid="5df9d3feea7c4d069de51b33ff29ce4b">tempest-ServerStableDeviceRescueTest-1738306522</nova:project>
Jul 27 18:03:42 user nova-compute[71206]:       </nova:owner>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:03:42 user nova-compute[71206]:       <nova:ports>
Jul 27 18:03:42 user nova-compute[71206]:         <nova:port uuid="061c4266-2991-4ee7-96f8-ee73173df5fa">
Jul 27 18:03:42 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:03:42 user nova-compute[71206]:         </nova:port>
Jul 27 18:03:42 user nova-compute[71206]:       </nova:ports>
Jul 27 18:03:42 user nova-compute[71206]:     </nova:instance>
Jul 27 18:03:42 user nova-compute[71206]:   </metadata>
Jul 27 18:03:42 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:03:42 user nova-compute[71206]:     <system>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="serial">71cb36ca-6721-4882-b30d-68ae8189e0c6</entry>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="uuid">71cb36ca-6721-4882-b30d-68ae8189e0c6</entry>
Jul 27 18:03:42 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:03:42 user nova-compute[71206]:     </system>
Jul 27 18:03:42 user nova-compute[71206]:   </sysinfo>
Jul 27 18:03:42 user nova-compute[71206]:   <os>
Jul 27 18:03:42 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:03:42 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:03:42 user nova-compute[71206]:   </os>
Jul 27 18:03:42 user nova-compute[71206]:   <features>
Jul 27 18:03:42 user nova-compute[71206]:     <acpi/>
Jul 27 18:03:42 user nova-compute[71206]:     <apic/>
Jul 27 18:03:42 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:03:42 user nova-compute[71206]:   </features>
Jul 27 18:03:42 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:03:42 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:03:42 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:03:42 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:03:42 user nova-compute[71206]:   </clock>
Jul 27 18:03:42 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:03:42 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:03:42 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:03:42 user nova-compute[71206]:   </cpu>
Jul 27 18:03:42 user nova-compute[71206]:   <devices>
Jul 27 18:03:42 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:42 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:42 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk"/>
Jul 27 18:03:42 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:03:42 user nova-compute[71206]:     </disk>
Jul 27 18:03:42 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:03:42 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:03:42 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:03:42 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:03:42 user nova-compute[71206]:       <serial>2205aa9d-fc29-4da9-acc6-fd052174e42c</serial>
Jul 27 18:03:42 user nova-compute[71206]:     </disk>
Jul 27 18:03:42 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:42 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:42 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue"/>
Jul 27 18:03:42 user nova-compute[71206]:       <target dev="vdc" bus="virtio"/>
Jul 27 18:03:42 user nova-compute[71206]:       <boot order="1"/>
Jul 27 18:03:42 user nova-compute[71206]:     </disk>
Jul 27 18:03:42 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:03:42 user nova-compute[71206]:       <mac address="fa:16:3e:ae:41:5b"/>
Jul 27 18:03:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:42 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:03:42 user nova-compute[71206]:       <target dev="tap061c4266-29"/>
Jul 27 18:03:42 user nova-compute[71206]:     </interface>
Jul 27 18:03:42 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:03:42 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/console.log" append="off"/>
Jul 27 18:03:42 user nova-compute[71206]:     </serial>
Jul 27 18:03:42 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:03:42 user nova-compute[71206]:     <video>
Jul 27 18:03:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:42 user nova-compute[71206]:     </video>
Jul 27 18:03:42 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:03:42 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:03:42 user nova-compute[71206]:     </rng>
Jul 27 18:03:42 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:03:42 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:03:42 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:03:42 user nova-compute[71206]:     </memballoon>
Jul 27 18:03:42 user nova-compute[71206]:   </devices>
Jul 27 18:03:42 user nova-compute[71206]: </domain>
Jul 27 18:03:42 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance destroyed successfully.
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] No VIF found with MAC fa:16:3e:ae:41:5b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da --force-share --output=json" returned: 0 in 0.164s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'migration_context' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.929s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.compute.manager [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Migrating
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Rebasing disk image.
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.compute.rpcapi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.compute.claims [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Claim successful on node user
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 -F raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:03:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:03:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.policy [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa59a3fcaa042999a5f0c357a5ef42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd626aa35a645b5b9ce1f5bf9652c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:03:43 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Creating image(s)
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.network.neutron [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Starting migrate_disk_and_power_off {{(pid=71206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk 1073741824" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Cannot resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.objects.instance [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'migration_context' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Ensure instance console log exists: /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:44 user nova-compute[71206]: WARNING nova.compute.manager [req-8726f786-aa64-4274-ad3f-3f4f09503dcf req-a17e15ef-4f1d-45d4-997b-5585332b2b44 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Successfully created port: 7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:44 user nova-compute[71206]: WARNING nova.compute.manager [req-2816045c-ec0a-42d6-8d7c-dcc0eedc6ec5 req-e8e5ca77-b234-4c8e-bdbf-d72b2c1ceffc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state active and task_state resize_migrating.
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance destroyed successfully.
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc85a1c7-e1, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:44 user nova-compute[71206]: INFO os_vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:44 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 -F raw /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk" returned: 0 in 2.644s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start _get_guest_xml network_info=[{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0406374c8ba48018cc433b65a9f0adfe',container_format='bare',created_at=2023-07-27T18:01:33Z,direct_url=<?>,disk_format='qcow2',id=b1bb403e-071d-4aac-9585-3a57cb9dea94,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-852198924-shelved',owner='3f383884701844a8b955177235bbbd4c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T18:01:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '99f61e72-6739-47a4-9698-e0b30b64051a', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQCxUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd1c93904-5854-4093-a782-58723eb98bb9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7102fdf-2983-4c96-ab34-ccf98fd7903d', 'serial': 'f7102fdf-2983-4c96-ab34-ccf98fd7903d'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1884bf91-09c0-4dd6-9df7-dd1456e3e664]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:03:44 user nova-compute[71206]: No targets found.
Jul 27 18:03:44 user nova-compute[71206]: iSNS:
Jul 27 18:03:44 user nova-compute[71206]: No targets found.
Jul 27 18:03:44 user nova-compute[71206]: STATIC:
Jul 27 18:03:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:03:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:03:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:03:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:03:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:03:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:03:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:03:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:03:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:03:44 user nova-compute[71206]: FIRMWARE:
Jul 27 18:03:44 user nova-compute[71206]: No targets found.
Jul 27 18:03:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:03:44 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:03:44 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:03:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61a6cc-25b8-48cd-9ecc-6db447e9d7f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0406374c8ba48018cc433b65a9f0adfe',container_format='bare',created_at=2023-07-27T18:01:33Z,direct_url=<?>,disk_format='qcow2',id=b1bb403e-071d-4aac-9585-3a57cb9dea94,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-852198924-shelved',owner='3f383884701844a8b955177235bbbd4c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T18:01:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661ee65-da84-47a9-b669-6d9634b04bfa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e241bd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQCxUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:45 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc3dd2-cbb5-42cd-a21b-0d0118ce95b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[744236f2-bf26-4259-be6b-056a5fe26c40]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30f60a-8207-4a37-9dad-486e588d090e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde59ad4-63ef-4d51-a017-3df23c5ab64e]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[903987ad-ab52-4c9c-826f-d9986485d6ac]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d717a3-7b70-42c2-83dc-79772a6c57d6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:03:45 user nova-compute[71206]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e8ee6-9cfb-4171-8ee1-caaf87c1e1ba]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== disconnect_volume: return (385ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.241s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:45 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:45 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0683d992-72d5-40ce-8d76-44a48f691834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:03:45 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88259bac-f359-4608-9ed1-cc2d6b5839bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d] added
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2687f0-bbf3-4ad6-8ed7-cf1057a0afd0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92aa3f-1469-4028-bad9-bb4756e9e1a3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLaQCxUI {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLaQCxUI" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79790781-75aa-40af-b3c3-c5b9c68459a0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLaQCxUI'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3085ce-eec7-4345-b4d2-d6655cbe3fb7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e7f812-e7e3-4358-9b77-d627f4d25878]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Successfully updated port: 7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a3526c-57b7-4606-8486-280d96a2b9ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260]
Jul 27 18:03:45 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260] successful.
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_resize/disk /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd54039-6f9e-4f9b-915f-e9d4bf60435f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a17dae-4db8-4db1-b944-8708c2daf5ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:45 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db25df7-c54f-4ccb-b9a1-b25dc7d722d0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:03:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQCxUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance network_info: |[{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start _get_guest_xml network_info=[{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:03:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.objects.instance [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'pci_devices' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:46 user nova-compute[71206]: WARNING nova.compute.manager [req-e80c45a3-0da7-44a7-b78a-86314b737e87 req-1138fa84-d8a4-4344-b477-2ec7524f185c service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state rescuing.
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:03:46 user nova-compute[71206]:   <uuid>7533b699-ec8e-46e4-828e-9cc82c802dce</uuid>
Jul 27 18:03:46 user nova-compute[71206]:   <name>instance-00000011</name>
Jul 27 18:03:46 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:03:46 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:03:46 user nova-compute[71206]:   <metadata>
Jul 27 18:03:46 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:03:46 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1846081917</nova:name>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:03:46</nova:creationTime>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:03:46 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:owner>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:user uuid="faa59a3fcaa042999a5f0c357a5ef42c">tempest-AttachVolumeTestJSON-497623291-project-member</nova:user>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:project uuid="7cd626aa35a645b5b9ce1f5bf9652c79">tempest-AttachVolumeTestJSON-497623291</nova:project>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:owner>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:ports>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:port uuid="7e52ab25-92dd-4d48-9037-a402f9f3c98b">
Jul 27 18:03:46 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:03:46 user nova-compute[71206]:         </nova:port>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:ports>
Jul 27 18:03:46 user nova-compute[71206]:     </nova:instance>
Jul 27 18:03:46 user nova-compute[71206]:   </metadata>
Jul 27 18:03:46 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:03:46 user nova-compute[71206]:     <system>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="serial">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="uuid">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:03:46 user nova-compute[71206]:     </system>
Jul 27 18:03:46 user nova-compute[71206]:   </sysinfo>
Jul 27 18:03:46 user nova-compute[71206]:   <os>
Jul 27 18:03:46 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:03:46 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:03:46 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:03:46 user nova-compute[71206]:   </os>
Jul 27 18:03:46 user nova-compute[71206]:   <features>
Jul 27 18:03:46 user nova-compute[71206]:     <acpi/>
Jul 27 18:03:46 user nova-compute[71206]:     <apic/>
Jul 27 18:03:46 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:03:46 user nova-compute[71206]:   </features>
Jul 27 18:03:46 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:03:46 user nova-compute[71206]:   </clock>
Jul 27 18:03:46 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:03:46 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:03:46 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:03:46 user nova-compute[71206]:   </cpu>
Jul 27 18:03:46 user nova-compute[71206]:   <devices>
Jul 27 18:03:46 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:46 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:46 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk"/>
Jul 27 18:03:46 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:     </disk>
Jul 27 18:03:46 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:03:46 user nova-compute[71206]:       <mac address="fa:16:3e:97:c1:c7"/>
Jul 27 18:03:46 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:03:46 user nova-compute[71206]:       <target dev="tap7e52ab25-92"/>
Jul 27 18:03:46 user nova-compute[71206]:     </interface>
Jul 27 18:03:46 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:03:46 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/console.log" append="off"/>
Jul 27 18:03:46 user nova-compute[71206]:     </serial>
Jul 27 18:03:46 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:03:46 user nova-compute[71206]:     <video>
Jul 27 18:03:46 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:     </video>
Jul 27 18:03:46 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:03:46 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:03:46 user nova-compute[71206]:     </rng>
Jul 27 18:03:46 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:03:46 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:03:46 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:03:46 user nova-compute[71206]:     </memballoon>
Jul 27 18:03:46 user nova-compute[71206]:   </devices>
Jul 27 18:03:46 user nova-compute[71206]: </domain>
Jul 27 18:03:46 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG os_vif [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e52ab25-92, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e52ab25-92, col_values=(('external_ids', {'iface-id': '7e52ab25-92dd-4d48-9037-a402f9f3c98b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c1:c7', 'vm-uuid': '7533b699-ec8e-46e4-828e-9cc82c802dce'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: INFO os_vif [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "cp -r /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_resize/disk /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk" returned: 0 in 0.658s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_resize/disk.info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk.info {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "cp -r /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_resize/disk.info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk.info" returned: 0 in 0.046s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No VIF found with MAC fa:16:3e:97:c1:c7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:46 user nova-compute[71206]: WARNING nova.compute.manager [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state active and task_state resize_migrating.
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-changed-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Refreshing instance network info cache due to event network-changed-7e52ab25-92dd-4d48-9037-a402f9f3c98b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Refreshing network info cache for port 7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 71cb36ca-6721-4882-b30d-68ae8189e0c6 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481026.5239081, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Resumed (Lifecycle Event)
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-c19e6720-2aa7-46e1-b7cc-ce3307936c7b tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481026.5245876, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Started (Lifecycle Event)
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] <== connect_volume: return (1743ms) {'type': 'block', 'scsi_wwn': '26334386362386633', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334386362386633', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='b1bb403e-071d-4aac-9585-3a57cb9dea94',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1398730537',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:01:37.584110',shelved_host='user',shelved_image_id='b1bb403e-071d-4aac-9585-3a57cb9dea94'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:03:46 user nova-compute[71206]:   <uuid>d1c93904-5854-4093-a782-58723eb98bb9</uuid>
Jul 27 18:03:46 user nova-compute[71206]:   <name>instance-00000006</name>
Jul 27 18:03:46 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:03:46 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:03:46 user nova-compute[71206]:   <metadata>
Jul 27 18:03:46 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:03:46 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-852198924</nova:name>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:03:44</nova:creationTime>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:03:46 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:owner>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:user uuid="4fa4ebea12dd4e89b0ae6097aae1bb7a">tempest-AttachVolumeShelveTestJSON-760609809-project-member</nova:user>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:project uuid="3f383884701844a8b955177235bbbd4c">tempest-AttachVolumeShelveTestJSON-760609809</nova:project>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:owner>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:root type="image" uuid="b1bb403e-071d-4aac-9585-3a57cb9dea94"/>
Jul 27 18:03:46 user nova-compute[71206]:       <nova:ports>
Jul 27 18:03:46 user nova-compute[71206]:         <nova:port uuid="a7201185-dc60-491f-852e-03df17fcb1bd">
Jul 27 18:03:46 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:03:46 user nova-compute[71206]:         </nova:port>
Jul 27 18:03:46 user nova-compute[71206]:       </nova:ports>
Jul 27 18:03:46 user nova-compute[71206]:     </nova:instance>
Jul 27 18:03:46 user nova-compute[71206]:   </metadata>
Jul 27 18:03:46 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:03:46 user nova-compute[71206]:     <system>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="serial">d1c93904-5854-4093-a782-58723eb98bb9</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="uuid">d1c93904-5854-4093-a782-58723eb98bb9</entry>
Jul 27 18:03:46 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:03:46 user nova-compute[71206]:     </system>
Jul 27 18:03:46 user nova-compute[71206]:   </sysinfo>
Jul 27 18:03:46 user nova-compute[71206]:   <os>
Jul 27 18:03:46 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:03:46 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:03:46 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:03:46 user nova-compute[71206]:   </os>
Jul 27 18:03:46 user nova-compute[71206]:   <features>
Jul 27 18:03:46 user nova-compute[71206]:     <acpi/>
Jul 27 18:03:46 user nova-compute[71206]:     <apic/>
Jul 27 18:03:46 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:03:46 user nova-compute[71206]:   </features>
Jul 27 18:03:46 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:03:46 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:03:46 user nova-compute[71206]:   </clock>
Jul 27 18:03:46 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:03:46 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:03:46 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:03:46 user nova-compute[71206]:   </cpu>
Jul 27 18:03:46 user nova-compute[71206]:   <devices>
Jul 27 18:03:46 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:46 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:46 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk"/>
Jul 27 18:03:46 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:     </disk>
Jul 27 18:03:46 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:03:46 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:03:46 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:03:46 user nova-compute[71206]:       <target dev="vdc" bus="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:       <serial>f7102fdf-2983-4c96-ab34-ccf98fd7903d</serial>
Jul 27 18:03:46 user nova-compute[71206]:     </disk>
Jul 27 18:03:46 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:03:46 user nova-compute[71206]:       <mac address="fa:16:3e:ce:66:13"/>
Jul 27 18:03:46 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:03:46 user nova-compute[71206]:       <target dev="tapa7201185-dc"/>
Jul 27 18:03:46 user nova-compute[71206]:     </interface>
Jul 27 18:03:46 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:03:46 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/console.log" append="off"/>
Jul 27 18:03:46 user nova-compute[71206]:     </serial>
Jul 27 18:03:46 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:03:46 user nova-compute[71206]:     <video>
Jul 27 18:03:46 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:46 user nova-compute[71206]:     </video>
Jul 27 18:03:46 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:03:46 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:03:46 user nova-compute[71206]:     </rng>
Jul 27 18:03:46 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:03:46 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:03:46 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:03:46 user nova-compute[71206]:     </memballoon>
Jul 27 18:03:46 user nova-compute[71206]:   </devices>
Jul 27 18:03:46 user nova-compute[71206]: </domain>
Jul 27 18:03:46 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='b1bb403e-071d-4aac-9585-3a57cb9dea94',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1398730537',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:01:37.584110',shelved_host='user',shelved_image_id='b1bb403e-071d-4aac-9585-3a57cb9dea94'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG os_vif [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7201185-dc, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7201185-dc, col_values=(('external_ids', {'iface-id': 'a7201185-dc60-491f-852e-03df17fcb1bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:66:13', 'vm-uuid': 'd1c93904-5854-4093-a782-58723eb98bb9'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:46 user nova-compute[71206]: INFO os_vif [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc')
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updated VIF entry in instance network info cache for port 7e52ab25-92dd-4d48-9037-a402f9f3c98b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ac144c4e-55db-4a31-ba35-346ef32696af req-24207812-8cd8-4401-bd3b-021c108485bc service nova] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No VIF found with MAC fa:16:3e:ce:66:13, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Port cc85a1c7-e1be-4e96-9640-8be9a65a8174 binding to destination host user is already ACTIVE {{(pid=71206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:03:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.utils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a125e884-a53f-4560-b76f-5852438038c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafc478-7365-41f2-838d-f7e124844be4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f2061a-d0a9-4574-b9fe-93b29dd62e16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f4114-e634-4194-a0ae-97d67d9ad024]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:03:48 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:03:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fa9bd6-cb5f-488a-bcf3-7ed14bce030e]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG os_brick.utils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481014.2530596, 24390c1b-61e1-4a56-92ae-cd7b79e67da6 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:49 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] VM Stopped (Lifecycle Event)
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cc642a15-edb5-488e-bde9-9f9546a8b268 None None] [instance: 24390c1b-61e1-4a56-92ae-cd7b79e67da6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:49 user nova-compute[71206]: WARNING nova.compute.manager [req-89bc2cf5-9e94-4c25-807f-76d2341541fa req-e9320d4c-020c-491b-91f1-ff40425842cb service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state building and task_state spawning.
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:49 user nova-compute[71206]: WARNING nova.compute.manager [req-0e86ce1f-43df-4fcf-85da-2516eb9fcd19 req-e3a6f7ef-cfdd-4565-8db0-90647b21225f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 18:03:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:51 user nova-compute[71206]: WARNING nova.compute.manager [req-fd0f6583-726b-4e16-b6ce-65fd2e8010a4 req-f58e6e7c-904b-4619-9b97-c88f91fa3d11 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state building and task_state spawning.
Jul 27 18:03:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:03:51 user nova-compute[71206]: WARNING nova.compute.manager [req-7df56919-8904-4d35-9b72-bb604cdaa05a req-c5bf512d-d383-4268-a833-abff9897084a service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 18:03:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481032.239798, d1c93904-5854-4093-a782-58723eb98bb9 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Resumed (Lifecycle Event)
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance spawned successfully.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481032.2400043, d1c93904-5854-4093-a782-58723eb98bb9 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Started (Lifecycle Event)
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481032.3735647, 7533b699-ec8e-46e4-828e-9cc82c802dce => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Resumed (Lifecycle Event)
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance spawned successfully.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481032.37732, 7533b699-ec8e-46e4-828e-9cc82c802dce => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Started (Lifecycle Event)
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Took 9.53 seconds to spawn the instance on the hypervisor.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:03:52 user nova-compute[71206]: INFO nova.compute.manager [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Took 10.53 seconds to build instance.
Jul 27 18:03:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f458922f-3dbb-4d5f-98c1-73c662a0870b tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.361s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-172f430f-c4ab-4c64-b858-c35949dc8b40 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.655s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Starting finish_migration {{(pid=71206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:03:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Creating image(s)
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.191s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk. size=21474836480 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk 21474836480 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk 21474836480" returned: 0 in 0.049s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Ensure instance console log exists: /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start _get_guest_xml network_info=[{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'd0aae134-e3df-4d86-a2db-f56e655fbf95', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '86884431-10bd-401b-9351-f56a32e82047', 'attached_at': '2023-07-27T18:03:57.000000', 'detached_at': '', 'volume_id': '68e5616e-97d1-4041-ab14-67fbed459212', 'serial': '68e5616e-97d1-4041-ab14-67fbed459212'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:03:58 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:58 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:03:58 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:58 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:03:58 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983f736-8180-4b41-822d-dfcec7dd997d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:03:58 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8daeef5-1b47-441d-9221-9136d8f98a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68526b22-5493-4330-bf68-758a51f4a67a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7772e439-d451-4c49-ba89-94a0a2211712]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[219e81cb-2915-470a-af7d-adffc2a76ab9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXbRKtDm'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[628dc7fc-fc44-4f09-a2bb-ed4990aeb22c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b85d9da-daf4-41e5-8557-cd1e1d66020d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd57e8d-f78e-49f1-b365-95df9da44ea6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:03:58 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1501b33-4983-4364-97f8-60de51a5111d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4a0a8-a292-4347-965d-2b45734c4c4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:03:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:03:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5c7fc8-c66a-45ce-be4a-d22ad6427cf0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:03:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:03:59 user nova-compute[71206]: INFO nova.compute.claims [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Claim successful on node user
Jul 27 18:03:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:03:59 user nova-compute[71206]:   <uuid>86884431-10bd-401b-9351-f56a32e82047</uuid>
Jul 27 18:03:59 user nova-compute[71206]:   <name>instance-00000003</name>
Jul 27 18:03:59 user nova-compute[71206]:   <memory>2097152</memory>
Jul 27 18:03:59 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:03:59 user nova-compute[71206]:   <metadata>
Jul 27 18:03:59 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:03:59 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1045738722</nova:name>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:03:58</nova:creationTime>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:flavor name="m1.small">
Jul 27 18:03:59 user nova-compute[71206]:         <nova:memory>2048</nova:memory>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:disk>20</nova:disk>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:03:59 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:owner>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:user uuid="a2e5a1cc2e1c45c9ae97077decdb228e">tempest-ServerActionsTestOtherB-86360800-project-member</nova:user>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:project uuid="5679fcb6cd0d4b6da2908fbf1d225eec">tempest-ServerActionsTestOtherB-86360800</nova:project>
Jul 27 18:03:59 user nova-compute[71206]:       </nova:owner>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:03:59 user nova-compute[71206]:       <nova:ports>
Jul 27 18:03:59 user nova-compute[71206]:         <nova:port uuid="cc85a1c7-e1be-4e96-9640-8be9a65a8174">
Jul 27 18:03:59 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:03:59 user nova-compute[71206]:         </nova:port>
Jul 27 18:03:59 user nova-compute[71206]:       </nova:ports>
Jul 27 18:03:59 user nova-compute[71206]:     </nova:instance>
Jul 27 18:03:59 user nova-compute[71206]:   </metadata>
Jul 27 18:03:59 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:03:59 user nova-compute[71206]:     <system>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="serial">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="uuid">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 18:03:59 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:03:59 user nova-compute[71206]:     </system>
Jul 27 18:03:59 user nova-compute[71206]:   </sysinfo>
Jul 27 18:03:59 user nova-compute[71206]:   <os>
Jul 27 18:03:59 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:03:59 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:03:59 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:03:59 user nova-compute[71206]:   </os>
Jul 27 18:03:59 user nova-compute[71206]:   <features>
Jul 27 18:03:59 user nova-compute[71206]:     <acpi/>
Jul 27 18:03:59 user nova-compute[71206]:     <apic/>
Jul 27 18:03:59 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:03:59 user nova-compute[71206]:   </features>
Jul 27 18:03:59 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:03:59 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:03:59 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:03:59 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:03:59 user nova-compute[71206]:   </clock>
Jul 27 18:03:59 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:03:59 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:03:59 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:03:59 user nova-compute[71206]:   </cpu>
Jul 27 18:03:59 user nova-compute[71206]:   <devices>
Jul 27 18:03:59 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:03:59 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:03:59 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk"/>
Jul 27 18:03:59 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:03:59 user nova-compute[71206]:     </disk>
Jul 27 18:03:59 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:03:59 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:03:59 user nova-compute[71206]:       <source dev="/dev/sde"/>
Jul 27 18:03:59 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:03:59 user nova-compute[71206]:       <serial>68e5616e-97d1-4041-ab14-67fbed459212</serial>
Jul 27 18:03:59 user nova-compute[71206]:     </disk>
Jul 27 18:03:59 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:03:59 user nova-compute[71206]:       <mac address="fa:16:3e:16:b7:4b"/>
Jul 27 18:03:59 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:59 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:03:59 user nova-compute[71206]:       <target dev="tapcc85a1c7-e1"/>
Jul 27 18:03:59 user nova-compute[71206]:     </interface>
Jul 27 18:03:59 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:03:59 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/console.log" append="off"/>
Jul 27 18:03:59 user nova-compute[71206]:     </serial>
Jul 27 18:03:59 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:03:59 user nova-compute[71206]:     <video>
Jul 27 18:03:59 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:03:59 user nova-compute[71206]:     </video>
Jul 27 18:03:59 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:03:59 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:03:59 user nova-compute[71206]:     </rng>
Jul 27 18:03:59 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:03:59 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:03:59 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:03:59 user nova-compute[71206]:     </memballoon>
Jul 27 18:03:59 user nova-compute[71206]:   </devices>
Jul 27 18:03:59 user nova-compute[71206]: </domain>
Jul 27 18:03:59 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-975323224-network", "vif_mac": "fa:16:3e:16:b7:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG os_vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc85a1c7-e1, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc85a1c7-e1, col_values=(('external_ids', {'iface-id': 'cc85a1c7-e1be-4e96-9640-8be9a65a8174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:4b', 'vm-uuid': '86884431-10bd-401b-9351-f56a32e82047'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:03:59 user nova-compute[71206]: INFO os_vif [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] No VIF found with MAC fa:16:3e:16:b7:4b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481024.9101558, 86884431-10bd-401b-9351-f56a32e82047 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:03:59 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Stopped (Lifecycle Event)
Jul 27 18:03:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:03:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-723583e8-7dab-44a4-b37b-5e0fc579ba20 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:04:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:04:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:04:00 user nova-compute[71206]: INFO nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Booting with volume f85b6e99-7a9b-48a5-922a-566e669056e1 at /dev/vda
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e783c-834e-4abf-a90e-530b830dbaa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9db6a-e77b-4779-8158-c07e972d5881]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG nova.policy [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3f40adb192148bfb69b75f693ba95e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da6d1cf37264fa180e2515f50834c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39603f45-f243-4bcb-9566-ed44073d588d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beea2a0-4ff9-4857-ad28-65795aa26c26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:00 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a2375-5dac-44e1-94e3-612007bf0dba]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:00 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating existing volume attachment record: b034c4b0-f224-42ab-8aab-cc77045a6e21 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully created port: 9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:01 user nova-compute[71206]: WARNING nova.compute.manager [req-4169d8e7-53fc-4c86-8a69-6138cb34a35a req-fbc679c8-3a7b-40fe-ac44-eaf9a3631831 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state active and task_state resize_finish.
Jul 27 18:04:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:02 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully created port: 4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully created port: 118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:03 user nova-compute[71206]: WARNING nova.compute.manager [req-f8336245-df17-40c7-8fc4-1252cfbdd11d req-d45a5fe2-dba8-4405-b458-f91bd33e12b7 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state active and task_state resize_finish.
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481044.0431826, 86884431-10bd-401b-9351-f56a32e82047 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Resumed (Lifecycle Event)
Jul 27 18:04:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance running successfully.
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Failed to set time: agent not configured {{(pid=71206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-2995d59f-f2ea-422b-9d90-d75d104d6ecd tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] finish_migration finished successfully. {{(pid=71206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481044.04337, 86884431-10bd-401b-9351-f56a32e82047 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Started (Lifecycle Event)
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 18:04:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully created port: e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully created port: 1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: 9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-9a2ec2a0-4559-443b-b3df-26de424d40fe. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.network.neutron [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.network.neutron [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG nova.network.neutron [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5757c42a-c2ae-4b91-a3da-b13bc46a81b0 req-c5213f9d-685c-4753-bab5-ce30784323c6 service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: 5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-5f47d46d-2a19-4f71-b1db-496a51b5a898. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-ed466868-da1f-4037-b7e4-7d6ba0d8f808. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aca56ec2-e98c-44e9-b25a-d6efc6f96885 req-c37bae5e-5048-4f0d-80f2-81975e62fd0d service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: 4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:10 user nova-compute[71206]: INFO nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Booting with volume ab09cc4d-fdc0-4009-b822-5e763ae1e907 at /dev/vdb
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35cdc9-1e17-419c-9c69-82d8c2af96de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a70692-c969-4a21-a937-07b3ae54f2fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83966f-311a-42f1-99a0-13e6f14b0c0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c884831-fe7d-4873-8f19-7369f7e6bf42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:10 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49350fed-d42f-40d1-9e78-dcde4e201bbc]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating existing volume attachment record: 470b4162-09a2-4b72-ba72-ccca43843910 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-4e352472-99d6-4b2f-b2ef-ac28bf3e0834. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: 118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-240705bf-519e-4ae4-a3cc-2c9d8b800a98 req-94c0b73b-6da2-4b5f-8e34-10a6bc023211 service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-118bf82a-ed4a-48a3-a8b7-61885ff5dd90. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-96385cab-58c5-4cc3-ac8c-a5faeef76aa0 req-1adcc8e7-cd94-4fc6-b3a4-c2aedf7c632d service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Successfully updated port: 1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:04:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:04:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-1fecd53c-e95d-436b-8c81-58d2a1f88291. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance network_info: |[{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updated VIF entry in instance network info cache for port 1fecd53c-e95d-436b-8c81-58d2a1f88291. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b1ee985-b39c-4f4d-80f8-8899c126bd33 req-ba0d5bfd-389a-4a3a-9a72-2075e2f7cda4 service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:18 user nova-compute[71206]: INFO nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Booting with volume 8311fb8c-4acc-4abb-a05d-8da332f1c2a4 at /dev/vdc
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2ce15-3796-4209-8cf1-aec37e5618ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d41b2-42d1-4c86-b321-1a7cc59146e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1710f6-ffc0-4ab8-b2a0-199bb7823ab8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f2b1b8-329a-48be-8724-dee3342c5755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:18 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[017479a3-3ee5-483c-b28b-ed0cdc0b01dc]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG os_brick.utils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:18 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating existing volume attachment record: 950593ce-cf3d-4b0f-9c83-641412970b8e {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:04:21 user nova-compute[71206]: INFO nova.compute.manager [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Rescuing
Jul 27 18:04:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:21 user nova-compute[71206]: DEBUG nova.network.neutron [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:22 user nova-compute[71206]: WARNING nova.compute.manager [req-4bb67287-02aa-4ae0-a78c-98b7e6ee2465 req-8a6afe37-c5a2-4cad-a855-42c809008acf service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state active and task_state rescuing.
Jul 27 18:04:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance destroyed successfully.
Jul 27 18:04:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Attempting rescue
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:04:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Creating image(s)
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.202s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start _get_guest_xml network_info=[{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:26:ed:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'numa_topology' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:23 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:23 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2065113690',display_name='tempest-ServerRescueNegativeTestJSON-server-2065113690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2065113690',id=5,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-iux9t49p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:59:54Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=7824a157-7697-4e8a-a212-201cf29cb062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:26:ed:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:26:ed:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:04:23 user nova-compute[71206]:   <uuid>7824a157-7697-4e8a-a212-201cf29cb062</uuid>
Jul 27 18:04:23 user nova-compute[71206]:   <name>instance-00000005</name>
Jul 27 18:04:23 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:04:23 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:04:23 user nova-compute[71206]:   <metadata>
Jul 27 18:04:23 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:04:23 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2065113690</nova:name>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:04:23</nova:creationTime>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:04:23 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:04:23 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:owner>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 18:04:23 user nova-compute[71206]:       </nova:owner>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:04:23 user nova-compute[71206]:       <nova:ports>
Jul 27 18:04:23 user nova-compute[71206]:         <nova:port uuid="41a69dfd-81be-4ffd-8d26-8ec2103c9ec9">
Jul 27 18:04:23 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 18:04:23 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:23 user nova-compute[71206]:       </nova:ports>
Jul 27 18:04:23 user nova-compute[71206]:     </nova:instance>
Jul 27 18:04:23 user nova-compute[71206]:   </metadata>
Jul 27 18:04:23 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:04:23 user nova-compute[71206]:     <system>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="serial">7824a157-7697-4e8a-a212-201cf29cb062</entry>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="uuid">7824a157-7697-4e8a-a212-201cf29cb062</entry>
Jul 27 18:04:23 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:04:23 user nova-compute[71206]:     </system>
Jul 27 18:04:23 user nova-compute[71206]:   </sysinfo>
Jul 27 18:04:23 user nova-compute[71206]:   <os>
Jul 27 18:04:23 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:04:23 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:04:23 user nova-compute[71206]:   </os>
Jul 27 18:04:23 user nova-compute[71206]:   <features>
Jul 27 18:04:23 user nova-compute[71206]:     <acpi/>
Jul 27 18:04:23 user nova-compute[71206]:     <apic/>
Jul 27 18:04:23 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:04:23 user nova-compute[71206]:   </features>
Jul 27 18:04:23 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:04:23 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:04:23 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:04:23 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:04:23 user nova-compute[71206]:   </clock>
Jul 27 18:04:23 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:04:23 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:04:23 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:04:23 user nova-compute[71206]:   </cpu>
Jul 27 18:04:23 user nova-compute[71206]:   <devices>
Jul 27 18:04:23 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:04:23 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:04:23 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue"/>
Jul 27 18:04:23 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:04:23 user nova-compute[71206]:     </disk>
Jul 27 18:04:23 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:04:23 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:04:23 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk"/>
Jul 27 18:04:23 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:04:23 user nova-compute[71206]:     </disk>
Jul 27 18:04:23 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:23 user nova-compute[71206]:       <mac address="fa:16:3e:26:ed:17"/>
Jul 27 18:04:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:23 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:23 user nova-compute[71206]:       <target dev="tap41a69dfd-81"/>
Jul 27 18:04:23 user nova-compute[71206]:     </interface>
Jul 27 18:04:23 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:04:23 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/console.log" append="off"/>
Jul 27 18:04:23 user nova-compute[71206]:     </serial>
Jul 27 18:04:23 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:04:23 user nova-compute[71206]:     <video>
Jul 27 18:04:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:23 user nova-compute[71206]:     </video>
Jul 27 18:04:23 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:04:23 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:04:23 user nova-compute[71206]:     </rng>
Jul 27 18:04:23 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:04:23 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:04:23 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:04:23 user nova-compute[71206]:     </memballoon>
Jul 27 18:04:23 user nova-compute[71206]:   </devices>
Jul 27 18:04:23 user nova-compute[71206]: </domain>
Jul 27 18:04:23 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:04:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance destroyed successfully.
Jul 27 18:04:23 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:26:ed:17, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:24 user nova-compute[71206]: WARNING nova.compute.manager [req-8ed0fd93-fa58-4c5e-94ca-38e514b07e3f req-5d146f6f-6bd9-4153-9bf8-47de49e724f0 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state active and task_state rescuing.
Jul 27 18:04:24 user nova-compute[71206]: INFO nova.compute.manager [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Rescuing
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [{"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-d1c93904-5854-4093-a782-58723eb98bb9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:26 user nova-compute[71206]: WARNING nova.compute.manager [req-febdbafc-2afc-4ea7-9887-e65bdef8f7d6 req-0989c3b8-c9c4-4722-a1cd-02e8a3e240ec service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state rescuing.
Jul 27 18:04:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:26 user nova-compute[71206]: WARNING nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state active and task_state rescuing.
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:26 user nova-compute[71206]: WARNING nova.compute.manager [req-b37470ec-9421-4c38-b9ae-bc6425848557 req-fcbbb279-e713-48c7-9894-8518b471b863 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state active and task_state rescuing.
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:26 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance destroyed successfully.
Jul 27 18:04:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Attempting a stable device rescue
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:04:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Creating image(s)
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 7824a157-7697-4e8a-a212-201cf29cb062 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481067.1699088, 7824a157-7697-4e8a-a212-201cf29cb062 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Resumed (Lifecycle Event)
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-804abe54-c85c-443c-81ba-e2da6d81e5f9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481067.1759439, 7824a157-7697-4e8a-a212-201cf29cb062 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Started (Lifecycle Event)
Jul 27 18:04:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.760s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.images [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] b437a85f-6337-4307-b855-9fcb91fa4654 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.part /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:04:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Creating image(s)
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Ensure instance console log exists: /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Start _get_guest_xml network_info=[{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'b034c4b0-f224-42ab-8aab-cc77045a6e21', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnkwqXAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5829c8dc-d719-4dd6-a811-c210007ae34d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f85b6e99-7a9b-48a5-922a-566e669056e1', 'serial': 'f85b6e99-7a9b-48a5-922a-566e669056e1'}, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': '470b4162-09a2-4b72-ba72-ccca43843910', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUlRiJVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5829c8dc-d719-4dd6-a811-c210007ae34d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab09cc4d-fdc0-4009-b822-5e763ae1e907', 'serial': 'ab09cc4d-fdc0-4009-b822-5e763ae1e907'}, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': '950593ce-cf3d-4b0f-9c83-641412970b8e', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfrvsYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5829c8dc-d719-4dd6-a811-c210007ae34d', 'attached_at': '', 'detached_at': '', 'volume_id': '8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 'serial': '8311fb8c-4acc-4abb-a05d-8da332f1c2a4'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:28 user nova-compute[71206]: WARNING nova.compute.manager [req-75652741-8e5a-4858-a5cd-233faa5c0d28 req-23534c40-2d67-4c8e-b3dc-06466308a3c5 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state rescuing.
Jul 27 18:04:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnkwqXAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:28 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:28 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:28 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.part /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.converted" returned: 0 in 0.255s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c2151-5517-403f-84fe-cc9d61ce4168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:04:28 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f6087-1a42-4d13-88e3-eaa19c644c9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1] added
Jul 27 18:04:28 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c188415b-08bc-4c65-8a64-297d0bd2eb3f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b346f-fb12-43ab-81c0-04d563653ca2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnkwqXAD {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.750s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnkwqXAD" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1064da31-4bc1-4868-ac00-8c551769da0c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnkwqXAD'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd859c97-18d1-4e02-9861-6d7c3d403800]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1469f-bf97-46ff-a7cb-43b290d11984]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:28 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:28 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:28 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb --force-share --output=json" returned: 0 in 0.178s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb,backing_fmt=raw /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043e767-52cd-49bc-8262-7cdbc167c9b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260]
Jul 27 18:04:29 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260] successful.
Jul 27 18:04:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb,backing_fmt=raw /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue" returned: 0 in 0.060s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "36c9a3166dce651c1378b44c6c3a477ef2b91aeb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'migration_context' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48fa21e-534a-4051-82c3-bdcd615f9c54]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start _get_guest_xml network_info=[{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:18:ed:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b437a85f-6337-4307-b855-9fcb91fa4654', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '6f5fbfde-645d-4ac0-8e93-45d26a20e705', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3564a8f7-d3c6-4a44-a8e0-05e6123987e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd15f2530-b185-42cc-a3c9-d10b3cb919ae', 'serial': 'd15f2530-b185-42cc-a3c9-d10b3cb919ae'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'numa_topology' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8390c-2ba5-4e49-ac84-b9b14912ee93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:29 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.594s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9377c050-506b-4e1d-9dde-fdb336f79b5c]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnkwqXAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:29 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.669s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== connect_volume: return (1673ms) {'type': 'block', 'scsi_wwn': '26562653464613364', 'path': '/dev/sdf'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562653464613364', 'path': '/dev/sdf'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.930s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:30 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b69c3e7-4046-4240-825b-75bb4554ef84]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = smagXquQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 18:04:30 user nova-compute[71206]: node.name = iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:04:30 user nova-compute[71206]: node.tpgt = -1
Jul 27 18:04:30 user nova-compute[71206]: node.startup = automatic
Jul 27 18:04:30 user nova-compute[71206]: node.leading_login = No
Jul 27 18:04:30 user nova-compute[71206]: iface.iscsi_ifacename = default
Jul 27 18:04:30 user nova-compute[71206]: iface.net_ifacename = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.ipaddress = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.prefix_len = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.hwaddress = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.transport_name = tcp
Jul 27 18:04:30 user nova-compute[71206]: iface.initiatorname = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.vlan_id = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.vlan_priority = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.vlan_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.iface_num = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.mtu = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.port = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.bootproto = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.subnet_mask = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.gateway = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_alt_client_id = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_dns = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_learn_iqn = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_vendor_id_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_vendor_id = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.dhcp_slp_da = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.fragmentation = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.gratuitous_arp = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.incoming_forwarding = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.tos_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.tos = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.ttl = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.delayed_ack = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.tcp_nagle = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.tcp_wsf_state = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.tcp_wsf = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.tcp_timer_scale = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.tcp_timestamp = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.redirect = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.def_task_mgmt_timeout = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.header_digest = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.data_digest = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.immediate_data = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.initial_r2t = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.data_seq_inorder = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.data_pdu_inorder = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.erl = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.max_receive_data_len = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.first_burst_len = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.max_outstanding_r2t = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.max_burst_len = 0
Jul 27 18:04:30 user nova-compute[71206]: iface.chap_auth = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.bidi_chap = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.strict_login_compliance = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.discovery_auth = <empty>
Jul 27 18:04:30 user nova-compute[71206]: iface.discovery_logout = <empty>
Jul 27 18:04:30 user nova-compute[71206]: node.discovery_address = <empty>
Jul 27 18:04:30 user nova-compute[71206]: node.discovery_port = 0
Jul 27 18:04:30 user nova-compute[71206]: node.discovery_type = static
Jul 27 18:04:30 user nova-compute[71206]: node.session.initial_cmdsn = 0
Jul 27 18:04:30 user nova-compute[71206]: node.session.initial_login_retry_max = 8
Jul 27 18:04:30 user nova-compute[71206]: node.session.xmit_thread_priority = -20
Jul 27 18:04:30 user nova-compute[71206]: node.session.cmds_max = 128
Jul 27 18:04:30 user nova-compute[71206]: node.session.queue_depth = 32
Jul 27 18:04:30 user nova-compute[71206]: node.session.nr_sessions = 1
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.authmethod = CHAP
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.username = smagXquQ
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.password = ***
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.username_in = <empty>
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.password_in = <empty>
Jul 27 18:04:30 user nova-compute[71206]: node.session.auth.chap_algs = MD5
Jul 27 18:04:30 user nova-compute[71206]: node.session.timeo.replacement_timeout = 120
Jul 27 18:04:30 user nova-compute[71206]: node.session.err_timeo.abort_timeout = 15
Jul 27 18:04:30 user nova-compute[71206]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 18:04:30 user nova-compute[71206]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 18:04:30 user nova-compute[71206]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.FastAbort = Yes
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.InitialR2T = No
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.ImmediateData = Yes
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.MaxConnections = 1
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 18:04:30 user nova-compute[71206]: node.session.iscsi.ERL = 0
Jul 27 18:04:30 user nova-compute[71206]: node.session.scan = manual
Jul 27 18:04:30 user nova-compute[71206]: node.session.reopen_max = 0
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].address = 172.16.0.220
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].port = 3260
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].startup = manual
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].tcp.window_size = 524288
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].tcp.type_of_service = 0
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].timeo.logout_timeout = 15
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].timeo.login_timeout = 15
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].timeo.auth_timeout = 45
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.DataDigest = None
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.IFMarker = No
Jul 27 18:04:30 user nova-compute[71206]: node.conn[0].iscsi.OFMarker = No
Jul 27 18:04:30 user nova-compute[71206]: # END RECORD
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUlRiJVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26e2eeb-79a6-4b3f-8790-16edb5fec0b4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18015a-2dcb-4b8c-a9e1-f1dd1b9c78b0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smagXquQ {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smagXquQ" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac37f2-0489-4c48-8d44-dadd9b817756]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smagXquQ'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[87748a55-05b0-4c32-8e6c-a588e810a4a2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f08a2f-1e48-4edc-aed9-72c3c3b22e89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] HCTL ('33', '0', '0', 0) found on session 8 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[735917a5-e736-49ce-a748-4af7a68ee610]: (4, ('0 0 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching for a device in session 8 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.332s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23565383363396235', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565383363396235', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:30 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95ad6b-e62d-46e7-b5c7-5748c34dc821]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:04:30 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778864700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778864700',id=14,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6cm75eep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:02:53Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=3564a8f7-d3c6-4a44-a8e0-05e6123987e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:18:ed:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:18:ed:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda69c2-fcdc-4a61-9adb-f71fa1627556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907] added
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:04:30 user nova-compute[71206]:   <uuid>3564a8f7-d3c6-4a44-a8e0-05e6123987e5</uuid>
Jul 27 18:04:30 user nova-compute[71206]:   <name>instance-0000000e</name>
Jul 27 18:04:30 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:04:30 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:04:30 user nova-compute[71206]:   <metadata>
Jul 27 18:04:30 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:04:30 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-778864700</nova:name>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:04:29</nova:creationTime>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:04:30 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:04:30 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:owner>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 18:04:30 user nova-compute[71206]:       </nova:owner>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:04:30 user nova-compute[71206]:       <nova:ports>
Jul 27 18:04:30 user nova-compute[71206]:         <nova:port uuid="2da326ce-e53a-43c4-9cf5-0ba3bab0527d">
Jul 27 18:04:30 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 18:04:30 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:30 user nova-compute[71206]:       </nova:ports>
Jul 27 18:04:30 user nova-compute[71206]:     </nova:instance>
Jul 27 18:04:30 user nova-compute[71206]:   </metadata>
Jul 27 18:04:30 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:04:30 user nova-compute[71206]:     <system>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="serial">3564a8f7-d3c6-4a44-a8e0-05e6123987e5</entry>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="uuid">3564a8f7-d3c6-4a44-a8e0-05e6123987e5</entry>
Jul 27 18:04:30 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:04:30 user nova-compute[71206]:     </system>
Jul 27 18:04:30 user nova-compute[71206]:   </sysinfo>
Jul 27 18:04:30 user nova-compute[71206]:   <os>
Jul 27 18:04:30 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:04:30 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:04:30 user nova-compute[71206]:   </os>
Jul 27 18:04:30 user nova-compute[71206]:   <features>
Jul 27 18:04:30 user nova-compute[71206]:     <acpi/>
Jul 27 18:04:30 user nova-compute[71206]:     <apic/>
Jul 27 18:04:30 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:04:30 user nova-compute[71206]:   </features>
Jul 27 18:04:30 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:04:30 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:04:30 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:04:30 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:04:30 user nova-compute[71206]:   </clock>
Jul 27 18:04:30 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:04:30 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:04:30 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:04:30 user nova-compute[71206]:   </cpu>
Jul 27 18:04:30 user nova-compute[71206]:   <devices>
Jul 27 18:04:30 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:04:30 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:04:30 user nova-compute[71206]:       <source dev="/dev/sdb"/>
Jul 27 18:04:30 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:04:30 user nova-compute[71206]:       <serial>d15f2530-b185-42cc-a3c9-d10b3cb919ae</serial>
Jul 27 18:04:30 user nova-compute[71206]:     </disk>
Jul 27 18:04:30 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:04:30 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:04:30 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue"/>
Jul 27 18:04:30 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:04:30 user nova-compute[71206]:       <boot order="1"/>
Jul 27 18:04:30 user nova-compute[71206]:     </disk>
Jul 27 18:04:30 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:30 user nova-compute[71206]:       <mac address="fa:16:3e:18:ed:63"/>
Jul 27 18:04:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:30 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:30 user nova-compute[71206]:       <target dev="tap2da326ce-e5"/>
Jul 27 18:04:30 user nova-compute[71206]:     </interface>
Jul 27 18:04:30 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:04:30 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/console.log" append="off"/>
Jul 27 18:04:30 user nova-compute[71206]:     </serial>
Jul 27 18:04:30 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:04:30 user nova-compute[71206]:     <video>
Jul 27 18:04:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:30 user nova-compute[71206]:     </video>
Jul 27 18:04:30 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:04:30 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:04:30 user nova-compute[71206]:     </rng>
Jul 27 18:04:30 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:04:30 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:04:30 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:04:30 user nova-compute[71206]:     </memballoon>
Jul 27 18:04:30 user nova-compute[71206]:   </devices>
Jul 27 18:04:30 user nova-compute[71206]: </domain>
Jul 27 18:04:30 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3276ff5-5ec1-4a84-a198-5294024456f6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be89ce6e-1325-44b4-8c48-30fc4ad42d31]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUlRiJVx {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance destroyed successfully.
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUlRiJVx" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b6dc4-693d-4160-aa47-c7082b60b768]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OUlRiJVx'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe042050-340b-48f4-853f-e6b6c8d5dc10]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:18:ed:63, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3766ee-9fe2-4577-8ff5-694f559c4715]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6a640-93b7-4a73-8f4e-65487464203f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260]
Jul 27 18:04:31 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260] successful.
Jul 27 18:04:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac8eaca-75b1-41d9-b2aa-41616d6a5b27]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-changed-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Refreshing instance network info cache due to event network-changed-2253410a-aa7f-409b-9519-32fcdf1f3bf4. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] Acquiring lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] Acquired lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Refreshing network info cache for port 2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fd0f23-f49e-466b-9142-c0385ae4fceb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.503s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c7e08-9426-4928-abcf-07814afa1c7c]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUlRiJVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG nova.network.neutron [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updated VIF entry in instance network info cache for port 2253410a-aa7f-409b-9519-32fcdf1f3bf4. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG nova.network.neutron [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating instance_info_cache with network_info: [{"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211d89b8-3ca2-4f80-a51f-6d5a95dfd444 req-df58992e-6f22-4c18-8322-39225f704dd9 service nova] Releasing lock "refresh_cache-764b00ce-48cb-472a-9bcd-0546f6cf3c4c" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.595s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== connect_volume: return (1869ms) {'type': 'block', 'scsi_wwn': '23138306566343566', 'path': '/dev/sdg'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138306566343566', 'path': '/dev/sdg'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfrvsYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:32 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb885be4-f3e0-4e8f-bbff-ffaaacfd1333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:04:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd3d08-d39e-4f92-9554-326089f711cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4] added
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b9b76-a5c4-4f3b-89ac-c0598860bd2c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9e37e-c221-4a5f-b169-98378f5cd5ec]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfrvsYkA {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfrvsYkA" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec12275-64cd-4db9-ae0e-271e446e7419]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfrvsYkA'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5c721-1b05-4ffc-948c-145775263ea2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f730d33-4f3f-4d6c-882e-fd1e11b8d68f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:32 user nova-compute[71206]: INFO nova.compute.manager [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attaching volume 7998a9df-c5a2-451d-8621-86d8b710a8e0 to /dev/vdb
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05fb24a-37ab-436f-954c-31afd839b746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260]
Jul 27 18:04:32 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260] successful.
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b308a-1409-4b8d-924f-89bb483761fe]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.utils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd1655-ca33-4526-999e-8bf65662b02b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] HCTL ('39', '-', '-', 0) found on session 16 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d979d-efae-4a94-b566-7405957d7aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dae0cb-bb20-4c12-a49c-b0f1d4f24240]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1bd774-13c5-413e-92fa-0812148c9bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Searching for a device in session 16 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfrvsYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2168fd56-bd90-47d8-87a8-e988fef6695a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5972b5-b8a5-4552-841b-58dc8b0a931e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:32 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de529e29-813a-4463-a702-8631409cc2c7]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG os_brick.utils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating existing volume attachment record: caeb6a48-d876-4e6d-8c37-1beb68b6a11b {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:33 user nova-compute[71206]: WARNING nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state rescuing.
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:33 user nova-compute[71206]: WARNING nova.compute.manager [req-35dceee7-81c6-4a32-80ba-25fb3ff793cc req-5950e55f-55b6-4858-9044-c2e6f96818cf service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state rescuing.
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.891s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== connect_volume: return (2894ms) {'type': 'block', 'scsi_wwn': '26235323462353538', 'path': '/dev/sdh'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235323462353538', 'path': '/dev/sdh'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481075.0102544, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:35 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Resumed (Lifecycle Event)
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-3ac3645b-8fc9-4229-adbe-0fc027915d47 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:35 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:35 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7051MB free_disk=25.41845703125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.objects.instance [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lazy-loading 'pci_devices' on Instance uuid 5829c8dc-d719-4dd6-a811-c210007ae34d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:04:35 user nova-compute[71206]:   <uuid>5829c8dc-d719-4dd6-a811-c210007ae34d</uuid>
Jul 27 18:04:35 user nova-compute[71206]:   <name>instance-00000012</name>
Jul 27 18:04:35 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:04:35 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:04:35 user nova-compute[71206]:   <metadata>
Jul 27 18:04:35 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:04:35 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:name>tempest-device-tagging-server-642480177</nova:name>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:04:28</nova:creationTime>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:04:35 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:04:35 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:owner>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:user uuid="c3f40adb192148bfb69b75f693ba95e2">tempest-TaggedBootDevicesTest_v242-401877799-project-member</nova:user>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:project uuid="9da6d1cf37264fa180e2515f50834c2b">tempest-TaggedBootDevicesTest_v242-401877799</nova:project>
Jul 27 18:04:35 user nova-compute[71206]:       </nova:owner>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:04:35 user nova-compute[71206]:       <nova:ports>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="9a2ec2a0-4559-443b-b3df-26de424d40fe">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="5f47d46d-2a19-4f71-b1db-496a51b5a898">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="ed466868-da1f-4037-b7e4-7d6ba0d8f808">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="4e352472-99d6-4b2f-b2ef-ac28bf3e0834">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="118bf82a-ed4a-48a3-a8b7-61885ff5dd90">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="e6ad559b-ac60-4f10-9abe-6ad06ebd63c6">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:         <nova:port uuid="1fecd53c-e95d-436b-8c81-58d2a1f88291">
Jul 27 18:04:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 18:04:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:04:35 user nova-compute[71206]:       </nova:ports>
Jul 27 18:04:35 user nova-compute[71206]:     </nova:instance>
Jul 27 18:04:35 user nova-compute[71206]:   </metadata>
Jul 27 18:04:35 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:04:35 user nova-compute[71206]:     <system>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="serial">5829c8dc-d719-4dd6-a811-c210007ae34d</entry>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="uuid">5829c8dc-d719-4dd6-a811-c210007ae34d</entry>
Jul 27 18:04:35 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:04:35 user nova-compute[71206]:     </system>
Jul 27 18:04:35 user nova-compute[71206]:   </sysinfo>
Jul 27 18:04:35 user nova-compute[71206]:   <os>
Jul 27 18:04:35 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:04:35 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:04:35 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:04:35 user nova-compute[71206]:   </os>
Jul 27 18:04:35 user nova-compute[71206]:   <features>
Jul 27 18:04:35 user nova-compute[71206]:     <acpi/>
Jul 27 18:04:35 user nova-compute[71206]:     <apic/>
Jul 27 18:04:35 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:04:35 user nova-compute[71206]:   </features>
Jul 27 18:04:35 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:04:35 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:04:35 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:04:35 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:04:35 user nova-compute[71206]:   </clock>
Jul 27 18:04:35 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:04:35 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:04:35 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:04:35 user nova-compute[71206]:   </cpu>
Jul 27 18:04:35 user nova-compute[71206]:   <devices>
Jul 27 18:04:35 user nova-compute[71206]:     <disk type="file" device="cdrom">
Jul 27 18:04:35 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 18:04:35 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/disk.config"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="hda" bus="ide"/>
Jul 27 18:04:35 user nova-compute[71206]:     </disk>
Jul 27 18:04:35 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:04:35 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:04:35 user nova-compute[71206]:       <source dev="/dev/sdf"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <serial>f85b6e99-7a9b-48a5-922a-566e669056e1</serial>
Jul 27 18:04:35 user nova-compute[71206]:     </disk>
Jul 27 18:04:35 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:04:35 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:04:35 user nova-compute[71206]:       <source dev="/dev/sdg"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <serial>ab09cc4d-fdc0-4009-b822-5e763ae1e907</serial>
Jul 27 18:04:35 user nova-compute[71206]:     </disk>
Jul 27 18:04:35 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:04:35 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:04:35 user nova-compute[71206]:       <source dev="/dev/sdh"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="vdc" bus="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <serial>8311fb8c-4acc-4abb-a05d-8da332f1c2a4</serial>
Jul 27 18:04:35 user nova-compute[71206]:     </disk>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:8c:0b:0a"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tap9a2ec2a0-45"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:2c:e5:93"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tap5f47d46d-2a"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:7a:4a:8e"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="taped466868-da"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:95:06:20"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tap4e352472-99"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:29:86:92"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tap118bf82a-ed"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:07:6d:52"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tape6ad559b-ac"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:04:35 user nova-compute[71206]:       <mac address="fa:16:3e:1a:11:59"/>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:04:35 user nova-compute[71206]:       <target dev="tap1fecd53c-e9"/>
Jul 27 18:04:35 user nova-compute[71206]:     </interface>
Jul 27 18:04:35 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:04:35 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/console.log" append="off"/>
Jul 27 18:04:35 user nova-compute[71206]:     </serial>
Jul 27 18:04:35 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:04:35 user nova-compute[71206]:     <video>
Jul 27 18:04:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:04:35 user nova-compute[71206]:     </video>
Jul 27 18:04:35 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:04:35 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:04:35 user nova-compute[71206]:     </rng>
Jul 27 18:04:35 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:04:35 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:04:35 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:04:35 user nova-compute[71206]:     </memballoon>
Jul 27 18:04:35 user nova-compute[71206]:   </devices>
Jul 27 18:04:35 user nova-compute[71206]: </domain>
Jul 27 18:04:35 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a2ec2a0-45, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a2ec2a0-45, col_values=(('external_ids', {'iface-id': '9a2ec2a0-4559-443b-b3df-26de424d40fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:0b:0a', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481075.011062, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:35 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Started (Lifecycle Event)
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f47d46d-2a, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f47d46d-2a, col_values=(('external_ids', {'iface-id': '5f47d46d-2a19-4f71-b1db-496a51b5a898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:e5:93', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Applying migration context for instance 86884431-10bd-401b-9351-f56a32e82047 as it has an incoming, in-progress migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf. Migration status is finished {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 18:04:35 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating resource usage from migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped466868-da, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped466868-da, col_values=(('external_ids', {'iface-id': 'ed466868-da1f-4037-b7e4-7d6ba0d8f808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:4a:8e', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d1c93904-5854-4093-a782-58723eb98bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 5829c8dc-d719-4dd6-a811-c210007ae34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e352472-99, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e352472-99, col_values=(('external_ids', {'iface-id': '4e352472-99d6-4b2f-b2ef-ac28bf3e0834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:06:20', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap118bf82a-ed, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap118bf82a-ed, col_values=(('external_ids', {'iface-id': '118bf82a-ed4a-48a3-a8b7-61885ff5dd90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:86:92', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6ad559b-ac, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6ad559b-ac, col_values=(('external_ids', {'iface-id': 'e6ad559b-ac60-4f10-9abe-6ad06ebd63c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:6d:52', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fecd53c-e9, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fecd53c-e9, col_values=(('external_ids', {'iface-id': '1fecd53c-e95d-436b-8c81-58d2a1f88291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:11:59', 'vm-uuid': '5829c8dc-d719-4dd6-a811-c210007ae34d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:35 user nova-compute[71206]: INFO os_vif [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9')
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] No BDM found with device name hda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] No VIF found with MAC fa:16:3e:8c:0b:0a, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:04:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] No VIF found with MAC fa:16:3e:29:86:92, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:04:35 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Using config drive
Jul 27 18:04:36 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:04:36 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:04:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:04:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.880s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Creating config drive at /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/disk.config
Jul 27 18:04:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbzx3n2pv {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbzx3n2pv" returned: 0 in 0.073s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:39 user nova-compute[71206]: WARNING nova.compute.manager [req-67df5532-3cab-4f96-9736-556a71b57822 req-447a8409-8e35-4340-ad29-e5ce9961bd56 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe for instance with vm_state building and task_state spawning.
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:39 user nova-compute[71206]: WARNING nova.compute.manager [req-9d1260e0-d722-479c-81e5-3788d810840b req-71a3698c-9bd8-4527-92da-79f5a88a9c24 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 for instance with vm_state building and task_state spawning.
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-1ed8aa12-5cfa-4310-89fc-ff43e0c10df7 req-6c8fa685-9fd0-401e-868f-c7faf6f0ed77 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:41 user nova-compute[71206]: WARNING nova.compute.manager [req-def9a8e9-b96d-40b4-bd34-1461c93aab5a req-f5183a1c-5e30-4529-9b84-4f39f994e72e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 for instance with vm_state building and task_state spawning.
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:43 user nova-compute[71206]: WARNING nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 for instance with vm_state building and task_state spawning.
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:43 user nova-compute[71206]: WARNING nova.compute.manager [req-b04ae6ba-ecda-413c-b1b2-e722f2f76941 req-f715930f-bf04-45a4-8361-676cb703078d service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 for instance with vm_state building and task_state spawning.
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:43 user nova-compute[71206]: WARNING nova.compute.manager [req-7a626a05-35b0-4fe1-b1cc-4aee3bcb644b req-5f766162-4c52-4ccb-9b0f-dea0ecd6b5a6 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 for instance with vm_state building and task_state spawning.
Jul 27 18:04:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKbVWxQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:43 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:43 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:04:43 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aeb1f6-8a07-4578-923f-89101d715581]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:04:43 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d37a1a-cfaa-436d-a2fb-ed35941e100a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0] added
Jul 27 18:04:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f146e-58f5-4d25-858e-9f5106082563]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[187671da-aaf5-403a-b36e-708c482dff6e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKbVWxQO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKbVWxQO" returned: 0 in 0.034s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6188c9-a993-4779-93b7-0654bab0a7a4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKbVWxQO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa211513-e2b8-43fe-a8d4-c72b1838f838]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c0ca0-9e0a-4981-ab17-8aba8fcad6f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481084.1030052, 5829c8dc-d719-4dd6-a811-c210007ae34d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] VM Resumed (Lifecycle Event)
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[976009c9-d0db-4f37-a08e-5836d7b81da7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260]
Jul 27 18:04:44 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260] successful.
Jul 27 18:04:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance spawned successfully.
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac6d36-0ec1-48c4-b5a7-d6e28e4e7fe3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481084.1131706, 5829c8dc-d719-4dd6-a811-c210007ae34d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] VM Started (Lifecycle Event)
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[76622504-a052-412d-9c4c-931086befffc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:04:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:04:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] HCTL ('40', '-', '-', 0) found on session 17 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe3f9b7-a031-4eaa-95fe-1044faa4893d]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Searching for a device in session 17 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:04:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKbVWxQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Took 15.79 seconds to spawn the instance on the hypervisor.
Jul 27 18:04:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:04:44 user nova-compute[71206]: INFO nova.compute.manager [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Took 45.20 seconds to build instance.
Jul 27 18:04:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-32485c92-05a4-4f9f-8866-39943c82a3f4 tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.334s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23361316237643164', 'path': '/dev/sdi'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361316237643164', 'path': '/dev/sdi'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:04:45 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:04:45 user nova-compute[71206]:   <source dev="/dev/sdi"/>
Jul 27 18:04:45 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:04:45 user nova-compute[71206]:   <serial>7998a9df-c5a2-451d-8621-86d8b710a8e0</serial>
Jul 27 18:04:45 user nova-compute[71206]: </disk>
Jul 27 18:04:45 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:45 user nova-compute[71206]: WARNING nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 for instance with vm_state active and task_state None.
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:45 user nova-compute[71206]: WARNING nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 for instance with vm_state active and task_state None.
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:45 user nova-compute[71206]: WARNING nova.compute.manager [req-ee7e5ddc-186d-450c-9de9-1fa0c1725688 req-59ddeb61-59c6-43fa-b22b-aa08a3d1e707 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 for instance with vm_state active and task_state None.
Jul 27 18:04:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:04:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No VIF found with MAC fa:16:3e:77:4c:d7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:04:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a3b90bbe-ed68-47ff-bee1-4ef98e51dd36 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.568s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:51 user nova-compute[71206]: INFO nova.compute.manager [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attaching volume 82f014e9-750f-41bc-8c97-8ff7815f5e09 to /dev/vdc
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.utils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c48405-8624-44cb-80f7-b90618a69dc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db99352-62e3-41b7-b753-9590ff3ebd30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d750f-57b0-49e0-9eba-edf1e228548d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e11252-9e1b-4058-b8ca-50890ad3569c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:51 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c99db-58b3-4f17-b782-cf15c8306447]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG os_brick.utils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:51 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating existing volume attachment record: f1dc7813-344f-4399-a45a-69537dd0f4b2 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:54 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:04:54 user nova-compute[71206]: INFO nova.compute.claims [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Claim successful on node user
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.812s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:04:55 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:04:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:04:55 user nova-compute[71206]: INFO nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Booting with volume d86a28a2-7474-445e-93f3-7fbf76a5d492 at /dev/vda
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG nova.policy [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e47d920c24f4a93b3efa2a111ec06fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911738e58ae64e67a9c625ef706e7299', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee5358-4b7b-41fb-bb29-e4fe0bdfaaa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6cc4a-b165-44e1-afb5-71658b200178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6fd360-0f6b-4a7e-974d-471cb63b8e27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f09ae-7b83-4f02-a0a0-35031038ebc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:04:56 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:04:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2903eb72-faac-449a-ab65-911597a6a122]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating existing volume attachment record: 68363fdf-855e-4137-864e-aa17c7b91206 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:04:56 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully created port: d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully created port: 1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:58 user nova-compute[71206]: INFO nova.compute.manager [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Terminating instance
Jul 27 18:04:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully created port: 9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-unplugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] No waiting events found dispatching network-vif-unplugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-115fb401-a8e4-42fb-b01b-49967fbbaef4 req-5ede52f2-31ad-42e6-97cb-f592051fb08a service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-unplugged-21646dd0-1c73-4b3a-96be-e94533074893 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:04:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Instance destroyed successfully.
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'resources' on Instance uuid 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-154227508',display_name='tempest-VolumesAdminNegativeTest-server-154227508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-154227508',id=16,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-xjq0yxkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:03:05Z,user_data=None,user_id='204444b73ce844fd9514fcc031569ae4',uuid=1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "21646dd0-1c73-4b3a-96be-e94533074893", "address": "fa:16:3e:2d:0b:28", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21646dd0-1c", "ovs_interfaceid": "21646dd0-1c73-4b3a-96be-e94533074893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG os_vif [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21646dd0-1c, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:04:59 user nova-compute[71206]: INFO os_vif [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0b:28,bridge_name='br-int',has_traffic_filtering=True,id=21646dd0-1c73-4b3a-96be-e94533074893,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21646dd0-1c')
Jul 27 18:04:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Deleting instance files /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b_del
Jul 27 18:04:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Deletion of /opt/stack/data/nova/instances/1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b_del complete
Jul 27 18:04:59 user nova-compute[71206]: INFO nova.compute.manager [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 27 18:04:59 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:04:59 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully created port: 9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:00 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Took 1.08 seconds to deallocate network for instance.
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IShNouBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:00 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1678006c-fe73-4408-bc79-b73fefb0da8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:00 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329676a-b0f2-4d3a-96a9-e7f0bca4b9cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09] added
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[354dcc28-becb-4149-b592-d7b03529b7cd]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a961f9b6-ae14-43af-9a33-a2651f48a444]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IShNouBf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IShNouBf" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfd24a-710c-415c-afdf-e2a39e3a9104]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IShNouBf'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0fa0eb-de52-43fb-8068-82889a0d2d04]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022e279-0f26-49a0-8b13-3f8a91a70422]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] Acquiring lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] No waiting events found dispatching network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:00 user nova-compute[71206]: WARNING nova.compute.manager [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received unexpected event network-vif-plugged-21646dd0-1c73-4b3a-96be-e94533074893 for instance with vm_state deleted and task_state None.
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-5fc84d55-c848-4abd-b3cd-b24420f289e4 req-63255247-fc8b-4197-9eb4-7635a240d09d service nova] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Received event network-vif-deleted-21646dd0-1c73-4b3a-96be-e94533074893 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4219758-8def-420d-9526-0864acb059e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260]
Jul 27 18:05:00 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb2f55c-d50d-4c3f-92fb-cb222cd6c50f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e30013d-8d38-4cad-8923-d927f282682c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)
Jul 27 18:05:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] HCTL ('41', '-', '-', 0) found on session 18 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62835a87-2aec-4a43-9798-1b2b4562858e]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Searching for a device in session 18 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IShNouBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:00 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:01 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Deleted allocations for instance 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b
Jul 27 18:05:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully created port: 72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-42d76e9b-87b0-4187-9465-7d2d10fe8b30 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23236366532333537', 'path': '/dev/sdj'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236366532333537', 'path': '/dev/sdj'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:01 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:05:02 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:02 user nova-compute[71206]:   <source dev="/dev/sdj"/>
Jul 27 18:05:02 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:05:02 user nova-compute[71206]:   <serial>82f014e9-750f-41bc-8c97-8ff7815f5e09</serial>
Jul 27 18:05:02 user nova-compute[71206]: </disk>
Jul 27 18:05:02 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] No VIF found with MAC fa:16:3e:77:4c:d7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7b1f7693-d493-4ce5-8eef-099a4d6a5708 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.364s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:03 user nova-compute[71206]: INFO nova.compute.manager [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Detaching volume 82f014e9-750f-41bc-8c97-8ff7815f5e09
Jul 27 18:05:03 user nova-compute[71206]: INFO nova.virt.block_device [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attempting to driver detach volume 82f014e9-750f-41bc-8c97-8ff7815f5e09 from mountpoint /dev/vdc
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Attempting to detach device vdc from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:03 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:03 user nova-compute[71206]:   <source dev="/dev/sdj"/>
Jul 27 18:05:03 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:05:03 user nova-compute[71206]:   <serial>82f014e9-750f-41bc-8c97-8ff7815f5e09</serial>
Jul 27 18:05:03 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:05:03 user nova-compute[71206]: </disk>
Jul 27 18:05:03 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully detached device vdc from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the persistent domain config.
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:03 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:03 user nova-compute[71206]:   <source dev="/dev/sdj"/>
Jul 27 18:05:03 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:05:03 user nova-compute[71206]:   <serial>82f014e9-750f-41bc-8c97-8ff7815f5e09</serial>
Jul 27 18:05:03 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:05:03 user nova-compute[71206]: </disk>
Jul 27 18:05:03 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.network.neutron [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-181e4e5c-a587-4be2-913e-7847f9722822 req-d540ed76-8ba8-4664-a5d8-752f357722ac service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481104.1975977, 764b00ce-48cb-472a-9bcd-0546f6cf3c4c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:05:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully detached device vdc from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the live domain config.
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IShNouBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:04 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.119s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb20da2-eaab-4a95-b13d-caad550798fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:04 user nova-compute[71206]: No targets found.
Jul 27 18:05:04 user nova-compute[71206]: iSNS:
Jul 27 18:05:04 user nova-compute[71206]: No targets found.
Jul 27 18:05:04 user nova-compute[71206]: STATIC:
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0
Jul 27 18:05:04 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:04 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:04 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:04 user nova-compute[71206]: No targets found.
Jul 27 18:05:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:04 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:04 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f759a30-1eae-433d-8b13-757128c9a618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebbb9d6-3c66-44a7-8207-dd4cfc51b9cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 (non-flash)
Jul 27 18:05:04 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e3289fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09'): ({'sdj'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Removing single pathed devices sdj {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b05d7a-419a-4b2d-996a-152609301c5a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4a839-61b6-4d30-b32e-91b5a46c060d]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Flushing IO for device /dev/sdj {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[836e4587-e8ed-400e-b6ad-0c3034a105ec]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda1a1c-60ff-4c9a-ace2-5421ffbd0bbf]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] SCSI volumes sdj have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca7cc3e-bdfb-42b9-88da-4a0d56bb515c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5d3709-5799-49cf-9344-dfab7ca577e5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260]
Jul 27 18:05:04 user nova-compute[71206]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f014e9-750f-41bc-8c97-8ff7815f5e09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c86ec-68bc-4d87-9641-3d24f7b33f24]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== disconnect_volume: return (492ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: 4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-4f119499-17fa-4f7d-b34e-9f0cfa97a389. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port 4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:05 user nova-compute[71206]: INFO nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Booting with volume 2d1a206c-38e6-4d2c-88d9-35c7d13721de at /dev/vdb
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[028983c6-06d6-4739-8e4e-9fec800629e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc33dc-d98b-4648-a0f6-5f3b60a352c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[81060f85-3b65-4f82-8587-614dc1a7fb7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b22fe6-c246-4623-97ae-ff9282aad4c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:05 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc33cfbe-56b5-4801-959b-1d24efa9038a]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating existing volume attachment record: 10e62471-7a6b-4a3c-a78e-3e7013a57dfa {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e72ec7ae-ac68-4bea-8bf8-71fc43003e47 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.146s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7101da45-f850-4f6b-8ccd-79d33d7d5622 req-ae156b4b-aeeb-43d4-b3f1-a45bd4a0913b service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: 1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-1901b7dd-6748-4cae-b9a5-d40673787e68. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:06 user nova-compute[71206]: DEBUG nova.network.neutron [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port 1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:07 user nova-compute[71206]: DEBUG nova.network.neutron [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: 9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:07 user nova-compute[71206]: DEBUG nova.network.neutron [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6922f5d6-1e12-4584-a62b-0aca2b4c6cea req-0340806f-23f2-4df8-8d35-67b4f6356a0c service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: 9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Successfully updated port: 72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-9dfc42f1-504a-4a02-a1d7-2647df17d4ed. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port 9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-9c278679-0086-4e45-9072-d85522ce99fc. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port 9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0560ace7-8b39-42ee-8bcf-7e2acf69e8a1 req-2acbb30e-38b0-43aa-9400-f1366f601ec4 service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:05:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:05:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-72fd96e1-984c-46b9-a370-1ff0bfaea923. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance network_info: |[{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:05:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port 72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updated VIF entry in instance network info cache for port 72fd96e1-984c-46b9-a370-1ff0bfaea923. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:05:13 user nova-compute[71206]: DEBUG nova.network.neutron [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d322c491-e596-46e7-aef4-7ed623e3c41b req-b7c22977-7279-4a6f-af44-2f6bf7d75ae2 service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:13 user nova-compute[71206]: INFO nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Booting with volume 7fe45ecc-f006-4c49-b898-a6e766bc5b05 at /dev/vdc
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf43a1-8ea7-4509-b2da-85534594e50c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e44176-e529-475f-9b66-449b44b24124]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89102368-6754-4d1f-8950-342ccb016736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf58b2f-1f15-48b7-b59c-ae30c541196e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481099.1124132, 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:14 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] VM Stopped (Lifecycle Event)
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:14 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:05:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b6b4f-3542-434c-9d62-583b5a6167e6]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG os_brick.utils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating existing volume attachment record: d17a50c3-2299-4bcf-9227-eded35168aaa {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f3447b60-45fe-472e-8f0d-9c1fe919eb33 None None] [instance: 1ff3baf2-b2eb-4bda-9eff-5bc1ec32bb5b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:16 user nova-compute[71206]: INFO nova.compute.manager [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Detaching volume f7102fdf-2983-4c96-ab34-ccf98fd7903d
Jul 27 18:05:16 user nova-compute[71206]: INFO nova.virt.block_device [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Attempting to driver detach volume f7102fdf-2983-4c96-ab34-ccf98fd7903d from mountpoint /dev/vdc
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Attempting to detach device vdc from instance d1c93904-5854-4093-a782-58723eb98bb9 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:16 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:16 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:05:16 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:05:16 user nova-compute[71206]:   <serial>f7102fdf-2983-4c96-ab34-ccf98fd7903d</serial>
Jul 27 18:05:16 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:05:16 user nova-compute[71206]: </disk>
Jul 27 18:05:16 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:16 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully detached device vdc from instance d1c93904-5854-4093-a782-58723eb98bb9 from the persistent domain config.
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d1c93904-5854-4093-a782-58723eb98bb9 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:16 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:16 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:05:16 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:05:16 user nova-compute[71206]:   <serial>f7102fdf-2983-4c96-ab34-ccf98fd7903d</serial>
Jul 27 18:05:16 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:05:16 user nova-compute[71206]: </disk>
Jul 27 18:05:16 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481116.9224622, d1c93904-5854-4093-a782-58723eb98bb9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:05:16 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully detached device vdc from instance d1c93904-5854-4093-a782-58723eb98bb9 from the live domain config.
Jul 27 18:05:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQCxUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:16 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99971c5a-80ea-4738-826e-5e81607067ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:16 user nova-compute[71206]: No targets found.
Jul 27 18:05:16 user nova-compute[71206]: iSNS:
Jul 27 18:05:16 user nova-compute[71206]: No targets found.
Jul 27 18:05:16 user nova-compute[71206]: STATIC:
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0
Jul 27 18:05:16 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:16 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:16 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:16 user nova-compute[71206]: No targets found.
Jul 27 18:05:16 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:16 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:16 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc1e04-eaac-4696-88e9-a24f4d4486d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b38890-664a-4e96-934b-ffc5d7f327af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2c1909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1c4ff-9987-4d02-937b-888a26cff1f5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8797ef1-03c7-4707-908a-05e5203c289c]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513fb26-09b9-48ab-9b35-61ba2287b040]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8c274-37a8-4eeb-ab48-bceeb840dd57]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb109b6-77ee-4d34-a5f0-ec6305ac0634]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01406f56-2c02-4346-9bc5-6e7975c10993]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260]
Jul 27 18:05:17 user nova-compute[71206]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7102fdf-2983-4c96-ab34-ccf98fd7903d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9988e000-590b-46c8-8471-f262d6af21df]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] <== disconnect_volume: return (398ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:20 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:05:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Creating image(s)
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Start _get_guest_xml network_info=[{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '68363fdf-855e-4137-864e-aa17c7b91206', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLolsPMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd86a28a2-7474-445e-93f3-7fbf76a5d492', 'serial': 'd86a28a2-7474-445e-93f3-7fbf76a5d492'}, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'attachment_id': '10e62471-7a6b-4a3c-a78e-3e7013a57dfa', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFIhcNGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb', 'attached_at': '', 'detached_at': '', 'volume_id': '2d1a206c-38e6-4d2c-88d9-35c7d13721de', 'serial': '2d1a206c-38e6-4d2c-88d9-35c7d13721de'}, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'attachment_id': 'd17a50c3-2299-4bcf-9227-eded35168aaa', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfmVPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb', 'attached_at': '', 'detached_at': '', 'volume_id': '7fe45ecc-f006-4c49-b898-a6e766bc5b05', 'serial': '7fe45ecc-f006-4c49-b898-a6e766bc5b05'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:05:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLolsPMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:22 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cda1b4-9d1d-420c-ba37-aa656ef85b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:22 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf27f0e-d7a1-4071-95de-1b170822cbf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492] added
Jul 27 18:05:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'flavor' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c959622f-088a-47d9-8a6f-770fdaf3702c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220e079-7c99-430e-b09a-4adee7bcba40]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLolsPMc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cba4ee2-585e-4bec-ae4c-1c7b09d9ef27 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.680s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLolsPMc" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36796b9-e046-4bfd-9045-7898cf31d0b0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLolsPMc'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284fcf0-7a0a-4728-918c-cd32d505cc50]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2150a0f-81f3-40a8-a2e9-4c4ae3abd6f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c87b3-05cc-46e4-a993-77133f45b768]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260]
Jul 27 18:05:23 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17fa881-0463-4e7b-998f-018e5647759e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64d171-2729-4d3e-90c1-8ab7e9b5cbdd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d4b1a-e720-4a97-b18b-d7a07d426d3c]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLolsPMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23139326330623535', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139326330623535', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFIhcNGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:24 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796b475-2d29-4824-8058-552546e9234c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:24 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d54e47-a509-4c01-995d-dd64b8390d73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de] added
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f0cdf-5816-4373-a12f-deb10c7af04c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1078dc-3b55-4613-926c-53842ec1ef34]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFIhcNGA {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFIhcNGA" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae7988d-abd2-4d89-95f0-2ed21242f50d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFIhcNGA'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b137f9a2-2e3f-449c-98f7-7c461fc7bdc1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b0c053-8306-4ac2-b6ec-daa3a2f5fb3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f449d-5d55-430d-be8d-4ad3db9c9099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260]
Jul 27 18:05:24 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f0a52-3584-4c9f-a117-c477ae7abf38]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa4742-9d71-4991-8f91-889c1b106dab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] HCTL ('41', '-', '-', 0) found on session 20 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb39ad6-884a-4852-83c0-6c9b2a0f0b55]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFIhcNGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26232633232306361', 'path': '/dev/sdj'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232633232306361', 'path': '/dev/sdj'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfmVPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:25 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[155515a0-3361-4f0a-8fb6-1ed84b74f08b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:25 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[165dd558-98a9-4fd3-a742-bdd21cae6f05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05] added
Jul 27 18:05:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b66ac-cc1c-4c71-8407-fcd5f2b6f712]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f8e97-6179-413a-8f9e-f86ff4ba350f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfmVPhQ {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGfmVPhQ" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845a3c8-25d8-444f-a336-fbe19a2348ee]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGfmVPhQ'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e09bde-96eb-4062-a8e0-085bdd51c2af]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f006eb-4bfa-4910-9d04-867cd2ff10cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8d76e-b15f-4cf5-abcd-cb94fbb8ca05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260]
Jul 27 18:05:26 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252ff22-8e33-4d12-9b51-955d0f5d0b0f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f0a75-acb7-4c3a-b605-f584104d7ebd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] HCTL ('42', '-', '-', 0) found on session 21 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78375f1c-5b03-4c23-a4b7-2f1540189798]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Searching for a device in session 21 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfmVPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: INFO nova.compute.manager [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Unrescuing
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '23562303264333532', 'path': '/dev/sdk'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562303264333532', 'path': '/dev/sdk'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:05:27 user nova-compute[71206]:   <uuid>9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb</uuid>
Jul 27 18:05:27 user nova-compute[71206]:   <name>instance-00000013</name>
Jul 27 18:05:27 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:05:27 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:05:27 user nova-compute[71206]:   <metadata>
Jul 27 18:05:27 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:05:27 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:name>tempest-device-tagging-server-2119966901</nova:name>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:05:22</nova:creationTime>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:05:27 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:05:27 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:owner>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:user uuid="7e47d920c24f4a93b3efa2a111ec06fd">tempest-TaggedBootDevicesTest-1545816997-project-member</nova:user>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:project uuid="911738e58ae64e67a9c625ef706e7299">tempest-TaggedBootDevicesTest-1545816997</nova:project>
Jul 27 18:05:27 user nova-compute[71206]:       </nova:owner>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:05:27 user nova-compute[71206]:       <nova:ports>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="d0ea3192-30bd-4db7-9586-8e1c9cc07ce2">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="4f119499-17fa-4f7d-b34e-9f0cfa97a389">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="1901b7dd-6748-4cae-b9a5-d40673787e68">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="9dfc42f1-504a-4a02-a1d7-2647df17d4ed">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="9c278679-0086-4e45-9072-d85522ce99fc">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:         <nova:port uuid="72fd96e1-984c-46b9-a370-1ff0bfaea923">
Jul 27 18:05:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 18:05:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:27 user nova-compute[71206]:       </nova:ports>
Jul 27 18:05:27 user nova-compute[71206]:     </nova:instance>
Jul 27 18:05:27 user nova-compute[71206]:   </metadata>
Jul 27 18:05:27 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:05:27 user nova-compute[71206]:     <system>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="serial">9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb</entry>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="uuid">9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb</entry>
Jul 27 18:05:27 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:05:27 user nova-compute[71206]:     </system>
Jul 27 18:05:27 user nova-compute[71206]:   </sysinfo>
Jul 27 18:05:27 user nova-compute[71206]:   <os>
Jul 27 18:05:27 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:05:27 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:05:27 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:05:27 user nova-compute[71206]:   </os>
Jul 27 18:05:27 user nova-compute[71206]:   <features>
Jul 27 18:05:27 user nova-compute[71206]:     <acpi/>
Jul 27 18:05:27 user nova-compute[71206]:     <apic/>
Jul 27 18:05:27 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:05:27 user nova-compute[71206]:   </features>
Jul 27 18:05:27 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:05:27 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:05:27 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:05:27 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:05:27 user nova-compute[71206]:   </clock>
Jul 27 18:05:27 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:05:27 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:05:27 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:05:27 user nova-compute[71206]:   </cpu>
Jul 27 18:05:27 user nova-compute[71206]:   <devices>
Jul 27 18:05:27 user nova-compute[71206]:     <disk type="file" device="cdrom">
Jul 27 18:05:27 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 18:05:27 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/disk.config"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="hda" bus="ide"/>
Jul 27 18:05:27 user nova-compute[71206]:     </disk>
Jul 27 18:05:27 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:05:27 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:27 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <serial>d86a28a2-7474-445e-93f3-7fbf76a5d492</serial>
Jul 27 18:05:27 user nova-compute[71206]:     </disk>
Jul 27 18:05:27 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:05:27 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:27 user nova-compute[71206]:       <source dev="/dev/sdj"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <serial>2d1a206c-38e6-4d2c-88d9-35c7d13721de</serial>
Jul 27 18:05:27 user nova-compute[71206]:     </disk>
Jul 27 18:05:27 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:05:27 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:27 user nova-compute[71206]:       <source dev="/dev/sdk"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="vdc" bus="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <serial>7fe45ecc-f006-4c49-b898-a6e766bc5b05</serial>
Jul 27 18:05:27 user nova-compute[71206]:     </disk>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:60:3f:29"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tapd0ea3192-30"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:60:85:fc"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tapf5b7f63f-7b"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:8a:56:7e"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tap4f119499-17"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:d4:6a:67"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tap1901b7dd-67"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:47:6f:56"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tap9dfc42f1-50"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:84:7a:d6"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tap9c278679-00"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:27 user nova-compute[71206]:       <mac address="fa:16:3e:f6:11:3f"/>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:27 user nova-compute[71206]:       <target dev="tap72fd96e1-98"/>
Jul 27 18:05:27 user nova-compute[71206]:     </interface>
Jul 27 18:05:27 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:05:27 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/console.log" append="off"/>
Jul 27 18:05:27 user nova-compute[71206]:     </serial>
Jul 27 18:05:27 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:05:27 user nova-compute[71206]:     <video>
Jul 27 18:05:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:27 user nova-compute[71206]:     </video>
Jul 27 18:05:27 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:05:27 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:05:27 user nova-compute[71206]:     </rng>
Jul 27 18:05:27 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:05:27 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:05:27 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:05:27 user nova-compute[71206]:     </memballoon>
Jul 27 18:05:27 user nova-compute[71206]:   </devices>
Jul 27 18:05:27 user nova-compute[71206]: </domain>
Jul 27 18:05:27 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ea3192-30, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0ea3192-30, col_values=(('external_ids', {'iface-id': 'd0ea3192-30bd-4db7-9586-8e1c9cc07ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:3f:29', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5b7f63f-7b, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5b7f63f-7b, col_values=(('external_ids', {'iface-id': 'f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:85:fc', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f119499-17, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f119499-17, col_values=(('external_ids', {'iface-id': '4f119499-17fa-4f7d-b34e-9f0cfa97a389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:56:7e', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1901b7dd-67, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1901b7dd-67, col_values=(('external_ids', {'iface-id': '1901b7dd-6748-4cae-b9a5-d40673787e68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:6a:67', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dfc42f1-50, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dfc42f1-50, col_values=(('external_ids', {'iface-id': '9dfc42f1-504a-4a02-a1d7-2647df17d4ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:6f:56', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c278679-00, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c278679-00, col_values=(('external_ids', {'iface-id': '9c278679-0086-4e45-9072-d85522ce99fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:7a:d6', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fd96e1-98, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72fd96e1-98, col_values=(('external_ids', {'iface-id': '72fd96e1-984c-46b9-a370-1ff0bfaea923', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:11:3f', 'vm-uuid': '9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'flavor' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:27 user nova-compute[71206]: INFO os_vif [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98')
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] No BDM found with device name hda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] No VIF found with MAC fa:16:3e:60:3f:29, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] No VIF found with MAC fa:16:3e:47:6f:56, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:05:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Using config drive
Jul 27 18:05:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing instance network info cache due to event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Creating config drive at /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/disk.config
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdirhyqma {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdirhyqma" returned: 0 in 0.081s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:28 user nova-compute[71206]: WARNING nova.compute.manager [req-401078fe-c232-4a80-bd31-153d798698c5 req-a6d398a6-a711-4f0c-b2f5-5ed136d6f250 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updated VIF entry in instance network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-57088f44-6b66-47c8-8500-0b8f4d8ccf33 req-ee80eb82-25b7-437b-af9e-9978949f6aec service nova] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance destroyed successfully.
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Port cc85a1c7-e1be-4e96-9640-8be9a65a8174 binding to destination host user is already ACTIVE {{(pid=71206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:05:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing instance network info cache due to event network-changed-061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Refreshing network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:30 user nova-compute[71206]: WARNING nova.compute.manager [req-92b56f01-6d5f-40bf-ba95-de756e2a30b1 req-24738f8a-63b0-40f8-b8e4-9007b65c2519 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Creating tmpfile /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/tmp3owspn_q to verify with other compute node that the instance is on the same shared storage. {{(pid=71206) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 27 18:05:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:30 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=6746MB free_disk=25.333629608154297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Applying migration context for instance 86884431-10bd-401b-9351-f56a32e82047 as it has an incoming, in-progress migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf. Migration status is reverting {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 18:05:31 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating resource usage from migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 80b19738-1683-4af2-a706-4ec8d9fd24e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d1c93904-5854-4093-a782-58723eb98bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 5829c8dc-d719-4dd6-a811-c210007ae34d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:31 user nova-compute[71206]: WARNING nova.compute.manager [req-f538c410-0950-49f3-8da2-63692fbd2bd0 req-3754c789-8d0f-4fbf-90c3-7e1ac6937da1 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state resized and task_state resize_reverting.
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updated VIF entry in instance network info cache for port 061c4266-2991-4ee7-96f8-ee73173df5fa. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae585eae-6ae3-4963-b70b-f4bb5470f6bd req-75eebc3a-6488-4205-8c66-6e3b52e3607b service nova] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:31 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.132s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING nova.compute.manager [req-d335de78-c699-44a7-b9e2-d9d43f35f051 req-69929277-4bee-4401-b192-25f574e88576 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 for instance with vm_state building and task_state spawning.
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 for instance with vm_state building and task_state spawning.
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 for instance with vm_state building and task_state spawning.
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING nova.compute.manager [req-38b89cd5-3031-4172-90bc-c8448fc96b4d req-3251851b-3c34-4574-a560-d20f2bf5e0a3 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:05:32 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance destroyed successfully.
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'resources' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc85a1c7-e1, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: INFO os_vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 18:05:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3555a2-b024-443b-8ed5-a25ab34ab9b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:32 user nova-compute[71206]: No targets found.
Jul 27 18:05:32 user nova-compute[71206]: iSNS:
Jul 27 18:05:32 user nova-compute[71206]: No targets found.
Jul 27 18:05:32 user nova-compute[71206]: STATIC:
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0
Jul 27 18:05:32 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:32 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:32 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:32 user nova-compute[71206]: No targets found.
Jul 27 18:05:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:32 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:32 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[133dc17e-db80-4d0e-a35a-7d8ccc3ee18a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b35399-78e7-435c-a311-dd908b952666]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:32 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e3289e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c4c09-f131-40b6-ae67-dbe8ed1475d5]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db37aa16-4434-4e71-ab46-9f280472b344]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7834202-c89d-44c5-9909-543bfe149a8c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8c32b-c2a8-473a-b095-dbfb4c07f89d]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eaf9eb-a633-4490-b883-0ddb8c088a78]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e8acc0-bccf-4358-bbfa-2f698e15b9e9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:05:33 user nova-compute[71206]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912cb7e-9934-4904-a3fd-f9fd2fe714e1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== disconnect_volume: return (419ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:33 user nova-compute[71206]: WARNING nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state resized and task_state resize_reverting.
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:33 user nova-compute[71206]: WARNING nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 for instance with vm_state building and task_state spawning.
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:33 user nova-compute[71206]: WARNING nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 for instance with vm_state building and task_state spawning.
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:33 user nova-compute[71206]: WARNING nova.compute.manager [req-f54a4438-0925-4d61-bc5c-2ff4eed96cd3 req-6ff3622e-b0c3-4a89-b5fa-90ea8fdad8e4 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 for instance with vm_state building and task_state spawning.
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:34 user nova-compute[71206]: WARNING nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 for instance with vm_state building and task_state spawning.
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:34 user nova-compute[71206]: WARNING nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed for instance with vm_state building and task_state spawning.
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:34 user nova-compute[71206]: WARNING nova.compute.manager [req-cc8cd75f-cfeb-482e-8b05-32542cd726c9 req-e2d67380-d7b8-4d51-a59b-0013c8a146b0 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed for instance with vm_state building and task_state spawning.
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [{"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-71cb36ca-6721-4882-b30d-68ae8189e0c6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'migration_context' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-changed-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Refreshing instance network info cache due to event network-changed-7e52ab25-92dd-4d48-9037-a402f9f3c98b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG nova.network.neutron [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Refreshing network info cache for port 7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 71cb36ca-6721-4882-b30d-68ae8189e0c6 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481135.12079, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:35 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Resumed (Lifecycle Event)
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-97121479-bc3f-4672-9bef-3740abd96493 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:05:35 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481135.123199, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:35 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Started (Lifecycle Event)
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.network.neutron [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updated VIF entry in instance network info cache for port 7e52ab25-92dd-4d48-9037-a402f9f3c98b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.network.neutron [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:35 user nova-compute[71206]: WARNING nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc for instance with vm_state building and task_state spawning.
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:35 user nova-compute[71206]: WARNING nova.compute.manager [req-229ffa94-b9c0-4865-9307-24389733a2af req-c527d558-b478-4939-bd50-1f041b587573 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc for instance with vm_state building and task_state spawning.
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.780s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:35 user nova-compute[71206]: INFO nova.compute.manager [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Swapping old allocation on dict_keys(['4946ae65-5eaf-4acb-8716-957c2a0b018d']) held by migration e0fdb5cc-22b8-4a18-9dbd-f94d91137faf for instance
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Overwriting current allocation {'allocations': {'4946ae65-5eaf-4acb-8716-957c2a0b018d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '5679fcb6cd0d4b6da2908fbf1d225eec', 'user_id': 'a2e5a1cc2e1c45c9ae97077decdb228e', 'consumer_generation': 1} on consumer 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquired lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING nova.compute.manager [req-211de954-b5f7-4507-b47c-3548c37b9217 req-906632ca-a3f2-4845-8082-f1091edb2bdb service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 for instance with vm_state building and task_state spawning.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Releasing lock "refresh_cache-86884431-10bd-401b-9351-f56a32e82047" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.utils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd2a806-1ac8-4246-b025-543bbb5c1c25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7f4e7c-7ae1-46c9-8b66-473fcf4e184a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e758518d-6273-46d0-b452-ad60cfa34ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c3cda-13ea-4d10-95ce-245e72a3963a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[719929c3-32cf-4065-85c5-e2ed5b9c980a]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG os_brick.utils [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 for instance with vm_state building and task_state spawning.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING nova.compute.manager [req-6dcc699a-9e4c-4005-9b9c-4f0aedb70c75 req-c27bd62e-9826-40a3-96d0-c051737980a5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 for instance with vm_state building and task_state spawning.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid db540ca5-3de8-47c3-968d-402bf58f5d6f {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 5829c8dc-d719-4dd6-a811-c210007ae34d {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "86884431-10bd-401b-9351-f56a32e82047" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "86884431-10bd-401b-9351-f56a32e82047" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7824a157-7697-4e8a-a212-201cf29cb062" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481136.6789951, 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] VM Resumed (Lifecycle Event)
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:36 user nova-compute[71206]: WARNING oslo_messaging._drivers.amqpdriver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance spawned successfully.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7824a157-7697-4e8a-a212-201cf29cb062" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481136.6800919, 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] VM Started (Lifecycle Event)
Jul 27 18:05:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:05:36 user nova-compute[71206]: INFO nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Took 14.13 seconds to spawn the instance on the hypervisor.
Jul 27 18:05:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:37 user nova-compute[71206]: INFO nova.compute.manager [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Took 42.25 seconds to build instance.
Jul 27 18:05:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04e371f6-69ad-48e9-8037-6855abb97af8 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.406s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.420s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:37 user nova-compute[71206]: INFO nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:05:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG nova.objects.instance [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:38 user nova-compute[71206]: INFO nova.compute.manager [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Attaching volume 00877c5f-71a0-459f-ade2-d6c988111832 to /dev/vdb
Jul 27 18:05:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.utils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed572e68-cc40-40d8-b95a-a8142fc0c75a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42adb50b-e176-4736-9afa-71dba919f263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d19607-d715-4fe8-a3fd-202b3a63e432]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[966fa2ef-3433-4c0f-be69-fe1718597e69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:05:38 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:05:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06665692-3b33-47e0-9e76-44c2d1ba1600]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG os_brick.utils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:38 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating existing volume attachment record: 3a1dd61e-9e3b-435c-8628-8c7b670a0ee3 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:05:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Starting finish_revert_migration {{(pid=71206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start _get_guest_xml network_info=[{"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'c35411f1-05ef-4afa-89d9-9e51070994f2', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '86884431-10bd-401b-9351-f56a32e82047', 'attached_at': '2023-07-27T18:05:46.000000', 'detached_at': '', 'volume_id': '68e5616e-97d1-4041-ab14-67fbed459212', 'serial': '68e5616e-97d1-4041-ab14-67fbed459212'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:05:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:46 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:46 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:46 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6f94a9-a2be-4149-849c-107dd5582e60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:46 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e08bc0-755a-4b9d-b8e4-46aecbd652e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212] added
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55494ba4-6f33-4c87-ad89-da20c3b6a5e8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ff883e-437d-4b28-be03-34842f39f950]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXbRKtDm" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9345a-a160-470a-8992-84c5e15f92fe]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXbRKtDm'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b26c00-e924-4d12-9b5d-038158866865]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2491b2-11e4-454e-9cdc-ce93e63c9954]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b6fbf-e6cc-461e-af2f-40fb9009531b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:05:46 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df5147f-1e68-49a9-9049-147f3c329130]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db667924-6d5e-4330-a93b-1ac7093b8da9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:46 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:46 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ff25d3-1f7e-49db-a594-fd5c9f861ab3]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:46 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481132.5873682, 86884431-10bd-401b-9351-f56a32e82047 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:47 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Stopped (Lifecycle Event)
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d604e583-1f29-4088-a84c-523fa54f619c None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313735343639', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.212s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:47 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52dc3ab-7fa1-41f0-9fd3-075a4152683e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:05:47 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:05:47 user nova-compute[71206]:   <uuid>86884431-10bd-401b-9351-f56a32e82047</uuid>
Jul 27 18:05:47 user nova-compute[71206]:   <name>instance-00000003</name>
Jul 27 18:05:47 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:05:47 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:05:47 user nova-compute[71206]:   <metadata>
Jul 27 18:05:47 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:05:47 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1045738722</nova:name>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:05:46</nova:creationTime>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:05:47 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:05:47 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:owner>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:user uuid="a2e5a1cc2e1c45c9ae97077decdb228e">tempest-ServerActionsTestOtherB-86360800-project-member</nova:user>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:project uuid="5679fcb6cd0d4b6da2908fbf1d225eec">tempest-ServerActionsTestOtherB-86360800</nova:project>
Jul 27 18:05:47 user nova-compute[71206]:       </nova:owner>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:05:47 user nova-compute[71206]:       <nova:ports>
Jul 27 18:05:47 user nova-compute[71206]:         <nova:port uuid="cc85a1c7-e1be-4e96-9640-8be9a65a8174">
Jul 27 18:05:47 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:05:47 user nova-compute[71206]:         </nova:port>
Jul 27 18:05:47 user nova-compute[71206]:       </nova:ports>
Jul 27 18:05:47 user nova-compute[71206]:     </nova:instance>
Jul 27 18:05:47 user nova-compute[71206]:   </metadata>
Jul 27 18:05:47 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:05:47 user nova-compute[71206]:     <system>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="serial">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="uuid">86884431-10bd-401b-9351-f56a32e82047</entry>
Jul 27 18:05:47 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:05:47 user nova-compute[71206]:     </system>
Jul 27 18:05:47 user nova-compute[71206]:   </sysinfo>
Jul 27 18:05:47 user nova-compute[71206]:   <os>
Jul 27 18:05:47 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:05:47 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:05:47 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:05:47 user nova-compute[71206]:   </os>
Jul 27 18:05:47 user nova-compute[71206]:   <features>
Jul 27 18:05:47 user nova-compute[71206]:     <acpi/>
Jul 27 18:05:47 user nova-compute[71206]:     <apic/>
Jul 27 18:05:47 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:05:47 user nova-compute[71206]:   </features>
Jul 27 18:05:47 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:05:47 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:05:47 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:05:47 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:05:47 user nova-compute[71206]:   </clock>
Jul 27 18:05:47 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:05:47 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:05:47 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:05:47 user nova-compute[71206]:   </cpu>
Jul 27 18:05:47 user nova-compute[71206]:   <devices>
Jul 27 18:05:47 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:05:47 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:05:47 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk"/>
Jul 27 18:05:47 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:05:47 user nova-compute[71206]:     </disk>
Jul 27 18:05:47 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:05:47 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:47 user nova-compute[71206]:       <source dev="/dev/sde"/>
Jul 27 18:05:47 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:05:47 user nova-compute[71206]:       <serial>68e5616e-97d1-4041-ab14-67fbed459212</serial>
Jul 27 18:05:47 user nova-compute[71206]:     </disk>
Jul 27 18:05:47 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:05:47 user nova-compute[71206]:       <mac address="fa:16:3e:16:b7:4b"/>
Jul 27 18:05:47 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:47 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:05:47 user nova-compute[71206]:       <target dev="tapcc85a1c7-e1"/>
Jul 27 18:05:47 user nova-compute[71206]:     </interface>
Jul 27 18:05:47 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:05:47 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/console.log" append="off"/>
Jul 27 18:05:47 user nova-compute[71206]:     </serial>
Jul 27 18:05:47 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:05:47 user nova-compute[71206]:     <video>
Jul 27 18:05:47 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:05:47 user nova-compute[71206]:     </video>
Jul 27 18:05:47 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:05:47 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:05:47 user nova-compute[71206]:     </rng>
Jul 27 18:05:47 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:05:47 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:05:47 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:05:47 user nova-compute[71206]:     </memballoon>
Jul 27 18:05:47 user nova-compute[71206]:   </devices>
Jul 27 18:05:47 user nova-compute[71206]: </domain>
Jul 27 18:05:47 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc85a1c7-e1, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc85a1c7-e1, col_values=(('external_ids', {'iface-id': 'cc85a1c7-e1be-4e96-9640-8be9a65a8174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b7:4b', 'vm-uuid': '86884431-10bd-401b-9351-f56a32e82047'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[172e13b4-0a0b-4b2b-a3d2-da3cbc0da3df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832] added
Jul 27 18:05:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:47 user nova-compute[71206]: INFO os_vif [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4847df9-6423-4c73-a877-7fffc4f2fabe]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf38398-190c-4674-84d1-b861c6cab5ad]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQDcdmxn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQDcdmxn" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb4024-9854-4249-bf68-b1dc60906397]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQDcdmxn'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c94bc-a73d-41de-9833-49b4ec2b058d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656ea08-d739-464e-9091-16be32db599a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[986bc478-6256-4278-b905-fd617c289d2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]
Jul 27 18:05:48 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[537f945f-1a3d-411f-b883-0bde6dc1b36a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac8d77f-ca45-45b7-8669-c4700802e238]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:48 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] HCTL ('43', '-', '-', 0) found on session 23 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24910ed-33ef-4e5b-9b67-3b32fc3121bd]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 23 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:05:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== connect_volume: return (1662ms) {'type': 'block', 'scsi_wwn': '23137616663373038', 'path': '/dev/sdl'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137616663373038', 'path': '/dev/sdl'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:05:49 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:49 user nova-compute[71206]:   <source dev="/dev/sdl"/>
Jul 27 18:05:49 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:05:49 user nova-compute[71206]:   <serial>00877c5f-71a0-459f-ade2-d6c988111832</serial>
Jul 27 18:05:49 user nova-compute[71206]: </disk>
Jul 27 18:05:49 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:49 user nova-compute[71206]: WARNING nova.compute.manager [req-2d53ee28-394b-4e35-8776-0b1d166226e2 req-9aabad89-f1f2-49b4-a041-39043081255e service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state resized and task_state resize_reverting.
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No VIF found with MAC fa:16:3e:97:c1:c7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa5fe96e-8940-47b5-9875-10f33d58eab3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.771s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG nova.objects.instance [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance destroyed successfully.
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:51 user nova-compute[71206]: WARNING nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state resized and task_state resize_reverting.
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:51 user nova-compute[71206]: WARNING nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state active and task_state powering-off.
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:51 user nova-compute[71206]: WARNING nova.compute.manager [req-24bf633a-a714-43de-bdfe-d5c264ce0edb req-20f3b1b7-cd2b-4a40-b063-3025d22f89f8 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state active and task_state powering-off.
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-887a1d4d-5525-4e5f-bd27-d7fc3a8c2041 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.070s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-changed-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing instance network info cache due to event network-changed-9a2ec2a0-4559-443b-b3df-26de424d40fe. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] Acquiring lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] Acquired lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:05:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Refreshing network info cache for port 9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481152.2239606, 86884431-10bd-401b-9351-f56a32e82047 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Resumed (Lifecycle Event)
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance running successfully.
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] finish_revert_migration finished successfully. {{(pid=71206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481152.226936, 86884431-10bd-401b-9351-f56a32e82047 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Started (Lifecycle Event)
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 18:05:52 user nova-compute[71206]: INFO nova.compute.manager [None req-fd56dd81-e09b-4779-a506-0334dc3ea157 tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance to original state: 'active'
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updated VIF entry in instance network info cache for port 9a2ec2a0-4559-443b-b3df-26de424d40fe. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be0c72e5-360b-4fca-a461-880dd41db391 req-6e7f0fe7-b327-4b70-8b1b-6351616587e4 service nova] Releasing lock "refresh_cache-5829c8dc-d719-4dd6-a811-c210007ae34d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:05:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:54 user nova-compute[71206]: INFO nova.compute.manager [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Detaching volume 7998a9df-c5a2-451d-8621-86d8b710a8e0
Jul 27 18:05:54 user nova-compute[71206]: INFO nova.virt.block_device [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Attempting to driver detach volume 7998a9df-c5a2-451d-8621-86d8b710a8e0 from mountpoint /dev/vdb
Jul 27 18:05:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Attempting to detach device vdb from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:05:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:54 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:54 user nova-compute[71206]:   <source dev="/dev/sdi"/>
Jul 27 18:05:54 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:05:54 user nova-compute[71206]:   <serial>7998a9df-c5a2-451d-8621-86d8b710a8e0</serial>
Jul 27 18:05:54 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:05:54 user nova-compute[71206]: </disk>
Jul 27 18:05:54 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully detached device vdb from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the persistent domain config.
Jul 27 18:05:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:05:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:05:54 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:05:54 user nova-compute[71206]:   <source dev="/dev/sdi"/>
Jul 27 18:05:54 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:05:54 user nova-compute[71206]:   <serial>7998a9df-c5a2-451d-8621-86d8b710a8e0</serial>
Jul 27 18:05:54 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:05:54 user nova-compute[71206]: </disk>
Jul 27 18:05:54 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481155.072613, 764b00ce-48cb-472a-9bcd-0546f6cf3c4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:05:55 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully detached device vdb from instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c from the live domain config.
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKbVWxQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:55 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ac56f-99d4-4161-b01a-e28d2c9eebf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:55 user nova-compute[71206]: No targets found.
Jul 27 18:05:55 user nova-compute[71206]: iSNS:
Jul 27 18:05:55 user nova-compute[71206]: No targets found.
Jul 27 18:05:55 user nova-compute[71206]: STATIC:
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0
Jul 27 18:05:55 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:55 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:55 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:55 user nova-compute[71206]: No targets found.
Jul 27 18:05:55 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:55 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:55 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4736856-bd8f-40ef-b320-d76a8c979747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ead085-85ce-4acc-beac-1fd3075d6703]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:55 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:55 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:55 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e243248b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0'): ({'sdi'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Removing single pathed devices sdi {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde38cb1-c4ad-4b85-b1a7-f42c124bd9c8]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27191d-3704-457b-8788-027948812af7]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Flushing IO for device /dev/sdi {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[87032b83-29de-4351-8ca7-36a8c2ff0035]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d419fc-c6f9-4f79-bee4-09481f875374]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] SCSI volumes sdi have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa5c2d6-bd75-435f-be85-0d6f78120f89]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:55 user nova-compute[71206]: INFO nova.compute.manager [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Terminating instance
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc164c6-59e5-44ed-8315-697a7a57a1fc]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260]
Jul 27 18:05:55 user nova-compute[71206]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:55 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7998a9df-c5a2-451d-8621-86d8b710a8e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.061s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ecb14-1c1d-4d00-809e-854e0e7bc203]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] <== disconnect_volume: return (450ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:55 user nova-compute[71206]: INFO nova.compute.manager [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Terminating instance
Jul 27 18:05:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-23529c3f-c594-4f39-9622-3664c37f0317 req-ce31114c-95ba-4f38-8d0a-eb58ac83b70a service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG nova.objects.instance [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'flavor' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-60c60341-be2e-48d9-a8a9-64f0a5131287 tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.519s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-5756e2dc-d2db-46f9-a528-6ec5214f2b99 req-de185436-bd41-4739-a404-1f9ab6238fbd service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-9a2ec2a0-4559-443b-b3df-26de424d40fe for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Instance destroyed successfully.
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lazy-loading 'resources' on Instance uuid 80b19738-1683-4af2-a706-4ec8d9fd24e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-6788576',display_name='tempest-VolumesAdminNegativeTest-server-6788576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-6788576',id=10,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfaOx8StgDGvN7b6iACZBDEuWkxCeDl89+w0LfAzbFMyCxrEonIet76dx3MfwX4Xfb3JAKG8e50e9f6bbpThUkQmK8I9p2HXy/1ipDBxWI/WIyPNlce3EHwzZ27PdyfKA==',key_name='tempest-keypair-800891234',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a4baf2bde924071b61112ce65124c1e',ramdisk_id='',reservation_id='r-jg6jejd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-426544505',owner_user_name='tempest-VolumesAdminNegativeTest-426544505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204444b73ce844fd9514fcc031569ae4',uuid=80b19738-1683-4af2-a706-4ec8d9fd24e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converting VIF {"id": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "address": "fa:16:3e:ab:2b:53", "network": {"id": "ce494fde-c915-4372-aa2c-a673f4586c5b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1992641976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a4baf2bde924071b61112ce65124c1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3a08c29-ae", "ovs_interfaceid": "f3a08c29-ae46-4a09-936a-142747a0b0e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG os_vif [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3a08c29-ae, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: INFO os_vif [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:2b:53,bridge_name='br-int',has_traffic_filtering=True,id=f3a08c29-ae46-4a09-936a-142747a0b0e7,network=Network(ce494fde-c915-4372-aa2c-a673f4586c5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3a08c29-ae')
Jul 27 18:05:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Deleting instance files /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5_del
Jul 27 18:05:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Deletion of /opt/stack/data/nova/instances/80b19738-1683-4af2-a706-4ec8d9fd24e5_del complete
Jul 27 18:05:57 user nova-compute[71206]: INFO nova.compute.manager [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Took 1.77 seconds to destroy the instance on the hypervisor.
Jul 27 18:05:57 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Instance destroyed successfully.
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lazy-loading 'resources' on Instance uuid 5829c8dc-d719-4dd6-a811-c210007ae34d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a2ec2a0-45, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:0b:0a,bridge_name='br-int',has_traffic_filtering=True,id=9a2ec2a0-4559-443b-b3df-26de424d40fe,network=Network(ed6ba1f5-07da-404b-a5fc-2322bceea769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2ec2a0-45')
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f47d46d-2a, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:e5:93,bridge_name='br-int',has_traffic_filtering=True,id=5f47d46d-2a19-4f71-b1db-496a51b5a898,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f47d46d-2a')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped466868-da, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed466868-da1f-4037-b7e4-7d6ba0d8f808,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped466868-da')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "address": "fa:16:3e:95:06:20", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e352472-99", "ovs_interfaceid": "4e352472-99d6-4b2f-b2ef-ac28bf3e0834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e352472-99, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:06:20,bridge_name='br-int',has_traffic_filtering=True,id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e352472-99')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap118bf82a-ed, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:86:92,bridge_name='br-int',has_traffic_filtering=True,id=118bf82a-ed4a-48a3-a8b7-61885ff5dd90,network=Network(9f22341c-9eb5-4af2-9f93-2edcb7c9692b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118bf82a-ed')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6ad559b-ac, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6d:52,bridge_name='br-int',has_traffic_filtering=True,id=e6ad559b-ac60-4f10-9abe-6ad06ebd63c6,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ad559b-ac')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-642480177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-642480177',id=18,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF0M+0LIK6L3H4nDNTR7g3LkNuvT6icO1FJf15FZeULqpkEMuBZku/ObtfYAjKEUFE58qIJ3L02zW2z8gCRv+Bt/tXd57ZVRPHRJ0CI2c7cQeHwpft72oPO9YHjkC7umQ==',key_name='tempest-keypair-1592839724',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9da6d1cf37264fa180e2515f50834c2b',ramdisk_id='',reservation_id='r-m6acuzf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-401877799',owner_user_name='tempest-TaggedBootDevicesTest_v242-401877799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3f40adb192148bfb69b75f693ba95e2',uuid=5829c8dc-d719-4dd6-a811-c210007ae34d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converting VIF {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fecd53c-e9, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: INFO os_vif [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:11:59,bridge_name='br-int',has_traffic_filtering=True,id=1fecd53c-e95d-436b-8c81-58d2a1f88291,network=Network(64b39de1-53dc-45a3-97d3-29aa27cceed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecd53c-e9')
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfrvsYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:58 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7db1d-980b-40e1-8d94-c0415edd73ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]: iSNS:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]: STATIC:
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:58 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:58 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:58 user nova-compute[71206]: WARNING nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-5f47d46d-2a19-4f71-b1db-496a51b5a898 for instance with vm_state active and task_state deleting.
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-unplugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] No waiting events found dispatching network-vif-unplugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-unplugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Acquiring lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] No waiting events found dispatching network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:58 user nova-compute[71206]: WARNING nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received unexpected event network-vif-plugged-f3a08c29-ae46-4a09-936a-142747a0b0e7 for instance with vm_state active and task_state deleting.
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:58 user nova-compute[71206]: WARNING nova.compute.manager [req-dd28bae8-185f-4b01-bd0f-fd83cd6d422c req-bb9c3a12-acd5-4817-879b-aef5825fca2e service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 for instance with vm_state active and task_state deleting.
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[215b488e-7cf3-4a72-b74a-97e457d0eefd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e05a4-3ad9-4c07-b53a-a3ac8117e00d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c7da950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4'): ({'sdh'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Removing single pathed devices sdh {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004387b-b197-4fbe-bbd0-0940b1cee547]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a0ccc-895e-4b05-84fd-4bb71243fcc0]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Flushing IO for device /dev/sdh {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7181f1-ead4-4e34-bc8e-c56877933b88]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e87eef-8c31-4cfb-a79b-7c532a02116c]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b2bfa-53bd-41e6-98bd-44dd096cebb1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.202s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b7d64-9542-4194-80d8-fef684c49bb0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260]
Jul 27 18:05:58 user nova-compute[71206]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8311fb8c-4acc-4abb-a05d-8da332f1c2a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c226e3-935d-4824-af80-cf2f495312d1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.572s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== disconnect_volume: return (578ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUlRiJVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:58 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca053540-574b-428e-b0cd-0fb73b853816]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]: iSNS:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]: STATIC:
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:05:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:58 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:58 user nova-compute[71206]: No targets found.
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:58 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:58 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adaabb5-2dc1-4209-9dda-4f500b35aeb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffb0e4c-7719-46c0-892e-0a3bc85be5d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c7d9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907'): ({'sdg'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Removing single pathed devices sdg {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df331f0-d8f2-44ae-9052-50e2afb68825]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[972aa190-b6dc-4ff7-a9d9-668cc123f098]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Flushing IO for device /dev/sdg {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe48927-a03f-4f26-b0c5-88a95637a6f6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: WARNING nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-9a2ec2a0-4559-443b-b3df-26de424d40fe for instance with vm_state active and task_state deleting.
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: WARNING nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-ed466868-da1f-4037-b7e4-7d6ba0d8f808 for instance with vm_state active and task_state deleting.
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: WARNING nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 for instance with vm_state active and task_state deleting.
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d309b47-d527-447f-b690-551ac732f8b3 req-9476b855-c572-43d0-8ee6-bd63354eb3f9 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d093290c-502a-4d6f-ba82-0645b7664a8f]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] SCSI volumes sdg have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b840bae8-363c-45ad-afd8-24b841ac6bfa]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4c6da-9449-4e0f-9eba-8e8a0458c264]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260]
Jul 27 18:05:59 user nova-compute[71206]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab09cc4d-fdc0-4009-b822-5e763ae1e907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69adc8c-1c93-47a9-be61-4855b4f39b68]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== disconnect_volume: return (475ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnkwqXAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:05:59 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded7f946-bf40-419c-a9cd-d0878b9561e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:05:59 user nova-compute[71206]: No targets found.
Jul 27 18:05:59 user nova-compute[71206]: iSNS:
Jul 27 18:05:59 user nova-compute[71206]: No targets found.
Jul 27 18:05:59 user nova-compute[71206]: STATIC:
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:05:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:05:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:05:59 user nova-compute[71206]: FIRMWARE:
Jul 27 18:05:59 user nova-compute[71206]: No targets found.
Jul 27 18:05:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:05:59 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:05:59 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a124a76-0df1-4cc7-8286-256b26b4b96a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f4b37-078c-43ad-89f7-6c3d4173db04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:05:59 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:05:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e241bca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1'): ({'sdf'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Removing single pathed devices sdf {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a987cd05-001c-45a4-82ea-77cf560d35ef]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf6034-8748-4b80-8b2e-4d31ce9504c4]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Flushing IO for device /dev/sdf {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[417879ed-a4fe-482e-a0d4-a233bbae0410]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df03fbf-8ed5-415d-952e-70e6537a06b2]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d0cd41-5a22-4f37-9748-678c81c1eda8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba7920b-3ad1-44fd-b36f-d026e272579f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260]
Jul 27 18:05:59 user nova-compute[71206]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1, portal: 172.16.0.220,3260] successful.
Jul 27 18:05:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:05:59 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Took 2.15 seconds to deallocate network for instance.
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85b6e99-7a9b-48a5-922a-566e669056e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db83c4-a9a1-40e4-9393-57b3ab81a8d2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] <== disconnect_volume: return (411ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:05:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Deleting instance files /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d_del
Jul 27 18:05:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Deletion of /opt/stack/data/nova/instances/5829c8dc-d719-4dd6-a811-c210007ae34d_del complete
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:05:59 user nova-compute[71206]: INFO nova.compute.manager [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Took 4.37 seconds to destroy the instance on the hypervisor.
Jul 27 18:05:59 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:05:59 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:00 user nova-compute[71206]: INFO nova.compute.manager [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Detaching volume 2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:00 user nova-compute[71206]: INFO nova.virt.block_device [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Attempting to driver detach volume 2205aa9d-fc29-4da9-acc6-fd052174e42c from mountpoint /dev/vdb
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Attempting to detach device vdb from instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:06:00 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:06:00 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:06:00 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:06:00 user nova-compute[71206]:   <serial>2205aa9d-fc29-4da9-acc6-fd052174e42c</serial>
Jul 27 18:06:00 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:06:00 user nova-compute[71206]: </disk>
Jul 27 18:06:00 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:06:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Successfully detached device vdb from instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 from the persistent domain config.
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:06:00 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:06:00 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:06:00 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:06:00 user nova-compute[71206]:   <serial>2205aa9d-fc29-4da9-acc6-fd052174e42c</serial>
Jul 27 18:06:00 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:06:00 user nova-compute[71206]: </disk>
Jul 27 18:06:00 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:06:00 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Deleted allocations for instance 80b19738-1683-4af2-a706-4ec8d9fd24e5
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-unplugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-unplugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:00 user nova-compute[71206]: WARNING nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-1fecd53c-e95d-436b-8c81-58d2a1f88291 for instance with vm_state active and task_state deleting.
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b2ee7ed-6371-4bcf-8691-f3931aff2197 req-65b103a4-d71d-439a-9fc3-d3651a1faadf service nova] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Received event network-vif-deleted-f3a08c29-ae46-4a09-936a-142747a0b0e7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0d4c492-e25e-41a6-be4c-fc5c82f92ef0 tempest-VolumesAdminNegativeTest-426544505 tempest-VolumesAdminNegativeTest-426544505-project-member] Lock "80b19738-1683-4af2-a706-4ec8d9fd24e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.798s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481160.9272954, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:06:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Successfully detached device vdb from instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 from the live domain config.
Jul 27 18:06:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrphtesF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4901b9-6082-40fc-987d-cc31754d3d6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:06:00 user nova-compute[71206]: No targets found.
Jul 27 18:06:00 user nova-compute[71206]: iSNS:
Jul 27 18:06:00 user nova-compute[71206]: No targets found.
Jul 27 18:06:00 user nova-compute[71206]: STATIC:
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:06:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:00 user nova-compute[71206]: FIRMWARE:
Jul 27 18:06:00 user nova-compute[71206]: No targets found.
Jul 27 18:06:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:06:00 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:06:00 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73590ca7-8429-40e6-8c46-4fa7051fbbf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bce2e5-712b-4d30-b589-d23313d4022f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:01 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24325240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1bb847-e465-4f4b-9bd6-bb85c662f344]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f254b47-52b9-449b-87b2-4e78a451b3ef]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628f405-436a-4d10-ba93-b051538738a5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb012bc-9b14-4aeb-a269-fd3f2082e3ac]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b5b35-e427-48a0-8cdb-e71b2dffe78c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] Acquiring lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] No waiting events found dispatching network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:01 user nova-compute[71206]: WARNING nova.compute.manager [req-898d1383-61db-46e6-b5a4-030487d77bd0 req-9175d16d-ee7a-4f9c-8d0e-9874a0a3d0ca service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received unexpected event network-vif-plugged-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 for instance with vm_state active and task_state deleting.
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a98eaa-39b8-45dd-95ca-6233ae390437]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260]
Jul 27 18:06:01 user nova-compute[71206]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c, portal: 172.16.0.220,3260] successful.
Jul 27 18:06:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2205aa9d-fc29-4da9-acc6-fd052174e42c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c538c33-daab-4f87-a705-107a2b2965ab]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] <== disconnect_volume: return (347ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:06:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'flavor' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ef5c7c93-ffee-464e-865b-84b247624f15 tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-4eb064bd-03ab-4cc4-911a-9de77e1d5656 req-74275a75-cd15-4158-bcdb-4b7f47328b62 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-deleted-4e352472-99d6-4b2f-b2ef-ac28bf3e0834 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:02 user nova-compute[71206]: INFO nova.compute.manager [req-4eb064bd-03ab-4cc4-911a-9de77e1d5656 req-74275a75-cd15-4158-bcdb-4b7f47328b62 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Neutron deleted interface 4e352472-99d6-4b2f-b2ef-ac28bf3e0834; detaching it from the instance and deleting it from the info cache
Jul 27 18:06:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-4eb064bd-03ab-4cc4-911a-9de77e1d5656 req-74275a75-cd15-4158-bcdb-4b7f47328b62 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [{"id": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "address": "fa:16:3e:8c:0b:0a", "network": {"id": "ed6ba1f5-07da-404b-a5fc-2322bceea769", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1629907888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2ec2a0-45", "ovs_interfaceid": "9a2ec2a0-4559-443b-b3df-26de424d40fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "address": "fa:16:3e:2c:e5:93", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f47d46d-2a", "ovs_interfaceid": "5f47d46d-2a19-4f71-b1db-496a51b5a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "address": "fa:16:3e:7a:4a:8e", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped466868-da", "ovs_interfaceid": "ed466868-da1f-4037-b7e4-7d6ba0d8f808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "address": "fa:16:3e:29:86:92", "network": {"id": "9f22341c-9eb5-4af2-9f93-2edcb7c9692b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1554292141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118bf82a-ed", "ovs_interfaceid": "118bf82a-ed4a-48a3-a8b7-61885ff5dd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "address": "fa:16:3e:07:6d:52", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ad559b-ac", "ovs_interfaceid": "e6ad559b-ac60-4f10-9abe-6ad06ebd63c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "address": "fa:16:3e:1a:11:59", "network": {"id": "64b39de1-53dc-45a3-97d3-29aa27cceed9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1063261298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9da6d1cf37264fa180e2515f50834c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecd53c-e9", "ovs_interfaceid": "1fecd53c-e95d-436b-8c81-58d2a1f88291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-4eb064bd-03ab-4cc4-911a-9de77e1d5656 req-74275a75-cd15-4158-bcdb-4b7f47328b62 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Detach interface failed, port_id=4e352472-99d6-4b2f-b2ef-ac28bf3e0834, reason: Instance 5829c8dc-d719-4dd6-a811-c210007ae34d could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:06:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:03 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:03 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Took 4.08 seconds to deallocate network for instance.
Jul 27 18:06:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4374d5d-afe8-4310-b70f-f95f857a5aed req-36cdfa6b-8574-4af4-ae98-a3e769be2dd8 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-deleted-9a2ec2a0-4559-443b-b3df-26de424d40fe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4374d5d-afe8-4310-b70f-f95f857a5aed req-36cdfa6b-8574-4af4-ae98-a3e769be2dd8 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-deleted-e6ad559b-ac60-4f10-9abe-6ad06ebd63c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4374d5d-afe8-4310-b70f-f95f857a5aed req-36cdfa6b-8574-4af4-ae98-a3e769be2dd8 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-deleted-1fecd53c-e95d-436b-8c81-58d2a1f88291 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e4374d5d-afe8-4310-b70f-f95f857a5aed req-36cdfa6b-8574-4af4-ae98-a3e769be2dd8 service nova] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Received event network-vif-deleted-118bf82a-ed4a-48a3-a8b7-61885ff5dd90 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:06 user nova-compute[71206]: INFO nova.compute.manager [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Took 2.43 seconds to detach 3 volumes for instance.
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481151.59392, 7533b699-ec8e-46e4-828e-9cc82c802dce => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:06 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Stopped (Lifecycle Event)
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-276aaffa-cf2d-4dfa-92d5-ba4942d55016 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-276aaffa-cf2d-4dfa-92d5-ba4942d55016 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:06 user nova-compute[71206]: INFO nova.compute.manager [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Terminating instance
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:06 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Deleted allocations for instance 5829c8dc-d719-4dd6-a811-c210007ae34d
Jul 27 18:06:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-33f81235-6dc1-4f2e-9f6b-93197fe7fbad tempest-TaggedBootDevicesTest_v242-401877799 tempest-TaggedBootDevicesTest_v242-401877799-project-member] Lock "5829c8dc-d719-4dd6-a811-c210007ae34d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.615s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-55f8596d-2f1e-4440-8ee5-018e4260ae50 req-4812bc7a-9c73-48a0-a3ea-642a855613d2 service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-unplugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Instance destroyed successfully.
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'resources' on Instance uuid d1c93904-5854-4093-a782-58723eb98bb9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-852198924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-852198924',id=6,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpXpxN//cqXL2CbTzpUViRWm87TtCfzxyOaA9/zigvj4d6W8AOBPdsnY2L0TfwW1qpHr7QA5x4Uk3a/uAmbpFu8TjE3F7Kv397LxSZ520rqGXuIaO8SvoyAi/kAb/blzw==',key_name='tempest-keypair-1398730537',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-cgtzrszr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=d1c93904-5854-4093-a782-58723eb98bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "a7201185-dc60-491f-852e-03df17fcb1bd", "address": "fa:16:3e:ce:66:13", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7201185-dc", "ovs_interfaceid": "a7201185-dc60-491f-852e-03df17fcb1bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG os_vif [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7201185-dc, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:07 user nova-compute[71206]: INFO os_vif [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:66:13,bridge_name='br-int',has_traffic_filtering=True,id=a7201185-dc60-491f-852e-03df17fcb1bd,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7201185-dc')
Jul 27 18:06:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Deleting instance files /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9_del
Jul 27 18:06:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Deletion of /opt/stack/data/nova/instances/d1c93904-5854-4093-a782-58723eb98bb9_del complete
Jul 27 18:06:07 user nova-compute[71206]: INFO nova.compute.manager [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 27 18:06:07 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:06:07 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:06:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:08 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:08 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Took 0.97 seconds to deallocate network for instance.
Jul 27 18:06:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-cb19f452-1a40-42fe-9a7d-59e31ac16448 req-479af7b0-6b47-4f4a-af0f-9f13112ea3cc service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-deleted-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:09 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Deleted allocations for instance d1c93904-5854-4093-a782-58723eb98bb9
Jul 27 18:06:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] Acquiring lock "d1c93904-5854-4093-a782-58723eb98bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] Lock "d1c93904-5854-4093-a782-58723eb98bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] No waiting events found dispatching network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:09 user nova-compute[71206]: WARNING nova.compute.manager [req-45624afb-2126-42dd-837b-2631dd0913f8 req-c59432e0-df73-4584-9e61-390aff6c639f service nova] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Received unexpected event network-vif-plugged-a7201185-dc60-491f-852e-03df17fcb1bd for instance with vm_state deleted and task_state None.
Jul 27 18:06:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1391a402-1dde-4f00-bdbf-f6978ecc892c tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "d1c93904-5854-4093-a782-58723eb98bb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.501s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:06:11 user nova-compute[71206]: INFO nova.compute.claims [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Claim successful on node user
Jul 27 18:06:11 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:11 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:06:12 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481157.0784533, 80b19738-1683-4af2-a706-4ec8d9fd24e5 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:12 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] VM Stopped (Lifecycle Event)
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-387e7c1b-a851-4e1b-996e-37eb8d60e354 None None] [instance: 80b19738-1683-4af2-a706-4ec8d9fd24e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:12 user nova-compute[71206]: INFO nova.virt.block_device [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Booting with volume snapshot 94baf44b-a75a-4433-b12d-e51a3cdda587 at /dev/vda
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.policy [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481157.5793407, 5829c8dc-d719-4dd6-a811-c210007ae34d => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:12 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] VM Stopped (Lifecycle Event)
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-33b2425f-9ca0-4e6a-824c-c966f3975934 None None] [instance: 5829c8dc-d719-4dd6-a811-c210007ae34d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:12 user nova-compute[71206]: INFO nova.compute.manager [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Unrescuing
Jul 27 18:06:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:06:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Successfully created port: 600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'flavor' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:14 user nova-compute[71206]: WARNING nova.compute.manager [req-944aa53f-e1da-4c8b-a855-6d2eed8d3988 req-30ef2a34-3115-4755-9b6b-ae17152dea0a service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Successfully updated port: 600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:06:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance destroyed successfully.
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-changed-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.compute.manager [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Refreshing instance network info cache due to event network-changed-600425f4-3543-4803-8fa9-2984ed24c6cf. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] Acquiring lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updating instance_info_cache with network_info: [{"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Instance network_info: |[{"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] Acquired lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Refreshing network info cache for port 600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updated VIF entry in instance network info cache for port 600425f4-3543-4803-8fa9-2984ed24c6cf. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updating instance_info_cache with network_info: [{"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-48561290-9c62-435c-aef6-a0b8fe6cbedc req-9f2a86d0-e87c-4c53-820f-f40a2da7f2b9 service nova] Releasing lock "refresh_cache-a6dca57e-608c-4778-98ed-4536fa6e3498" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: INFO nova.compute.manager [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Unrescuing
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:16 user nova-compute[71206]: WARNING nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:16 user nova-compute[71206]: WARNING nova.compute.manager [req-172c8d1c-3aad-41f9-922f-09d4ea433aaf req-fcbce51b-1af9-4b80-a7f3-9d20417e4cdb service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'flavor' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:17 user nova-compute[71206]: WARNING nova.compute.manager [req-5949d608-4ac1-4f28-93be-3f50e7da33fb req-3809999b-af74-414f-8968-246ae6b2639a service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:17 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance destroyed successfully.
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.utils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[808f7788-fe20-490f-a77f-f2ee58dea88d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a2322-4c1b-41a8-b0e0-9aee4957c3ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b4528-7cf7-4cd1-92f6-19b84b66ffe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf5684f-e37f-4ced-8e7b-65a027c78db6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:06:17 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:06:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9598b36-6d2a-4073-94c6-73ee856d96bd]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG os_brick.utils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:17 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updating existing volume attachment record: e4ca8bf8-c8a0-4bc9-bb2d-1bd21bcb1d25 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 7824a157-7697-4e8a-a212-201cf29cb062 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481178.3750346, 7824a157-7697-4e8a-a212-201cf29cb062 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:18 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Resumed (Lifecycle Event)
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f01af76-9e98-463d-89f9-ec20ffd967bb tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:18 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481178.380736, 7824a157-7697-4e8a-a212-201cf29cb062 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:18 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Started (Lifecycle Event)
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:18 user nova-compute[71206]: WARNING nova.compute.manager [req-b5cdcff9-5a2c-4c60-99d7-91b209bd7e91 req-065a3c03-a794-443b-b04c-e8979de71b17 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state active and task_state None.
Jul 27 18:06:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:19 user nova-compute[71206]: WARNING nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:19 user nova-compute[71206]: WARNING nova.compute.manager [req-94821f18-3e80-4c03-a32d-a353f030517f req-8f89be53-a221-4a4b-8c41-93358cd9a8f8 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:06:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481181.1159656, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:21 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Resumed (Lifecycle Event)
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9aaa6d3c-33e0-4af1-9e99-e98585cf29f6 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:21 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481181.117228, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:21 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Started (Lifecycle Event)
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:21 user nova-compute[71206]: WARNING nova.compute.manager [req-30616c82-27ea-4eb9-9166-adef36eb9c36 req-2feafa81-70a8-463b-b76f-fbedff99eecc service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state None.
Jul 27 18:06:22 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481167.6079195, d1c93904-5854-4093-a782-58723eb98bb9 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:22 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d1c93904-5854-4093-a782-58723eb98bb9] VM Stopped (Lifecycle Event)
Jul 27 18:06:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-06248533-6903-4611-ad4e-113dbb7e01d3 None None] [instance: d1c93904-5854-4093-a782-58723eb98bb9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:06:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Creating image(s)
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Ensure instance console log exists: /opt/stack/data/nova/instances/a6dca57e-608c-4778-98ed-4536fa6e3498/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Start _get_guest_xml network_info=[{"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'e4ca8bf8-c8a0-4bc9-bb2d-1bd21bcb1d25', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpJxWeBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6dca57e-608c-4778-98ed-4536fa6e3498', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1a950c8-a3b5-4102-894a-411978408d01', 'serial': 'd1a950c8-a3b5-4102-894a-411978408d01'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:06:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:06:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpJxWeBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:25 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ead1b0e-35b3-4e0a-ad64-4b5f23cce095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:06:25 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe6406b-2878-44fd-9691-c252975cb10b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01] added
Jul 27 18:06:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35e64b-a964-49c2-bf09-d43183260be0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[688eac96-7702-4dd4-bc2e-9a08c0efa117]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpJxWeBt {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TpJxWeBt" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6f6edb-740a-4225-a1b9-e713088f9b24]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TpJxWeBt'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5107358-74e9-4ed3-ae22-4c35e97f7f29]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27cfec-d265-4607-8677-a470db215c2b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:25 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[926cbe90-859b-4a5b-9268-dfa97ddd06b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260]
Jul 27 18:06:26 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260] successful.
Jul 27 18:06:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[70feac36-aa7a-4f55-90b0-aa671d405456]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7501e-2048-4a6b-b0d0-f5722ae16787]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:26 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81405e-8351-43ba-ba83-e269f80d40e1]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpJxWeBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23961373164316566', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961373164316566', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2008976302',display_name='tempest-TestVolumeBootPattern-server-2008976302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2008976302',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-rm8apdl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:06:12Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=a6dca57e-608c-4778-98ed-4536fa6e3498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid a6dca57e-608c-4778-98ed-4536fa6e3498 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:06:27 user nova-compute[71206]:   <uuid>a6dca57e-608c-4778-98ed-4536fa6e3498</uuid>
Jul 27 18:06:27 user nova-compute[71206]:   <name>instance-00000014</name>
Jul 27 18:06:27 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:06:27 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:06:27 user nova-compute[71206]:   <metadata>
Jul 27 18:06:27 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:06:27 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:06:27 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-server-2008976302</nova:name>
Jul 27 18:06:27 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:06:25</nova:creationTime>
Jul 27 18:06:27 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:06:27 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:06:27 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:06:27 user nova-compute[71206]:       <nova:owner>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:06:27 user nova-compute[71206]:       </nova:owner>
Jul 27 18:06:27 user nova-compute[71206]:       <nova:ports>
Jul 27 18:06:27 user nova-compute[71206]:         <nova:port uuid="600425f4-3543-4803-8fa9-2984ed24c6cf">
Jul 27 18:06:27 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:06:27 user nova-compute[71206]:         </nova:port>
Jul 27 18:06:27 user nova-compute[71206]:       </nova:ports>
Jul 27 18:06:27 user nova-compute[71206]:     </nova:instance>
Jul 27 18:06:27 user nova-compute[71206]:   </metadata>
Jul 27 18:06:27 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:06:27 user nova-compute[71206]:     <system>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="serial">a6dca57e-608c-4778-98ed-4536fa6e3498</entry>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="uuid">a6dca57e-608c-4778-98ed-4536fa6e3498</entry>
Jul 27 18:06:27 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:06:27 user nova-compute[71206]:     </system>
Jul 27 18:06:27 user nova-compute[71206]:   </sysinfo>
Jul 27 18:06:27 user nova-compute[71206]:   <os>
Jul 27 18:06:27 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:06:27 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:06:27 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:06:27 user nova-compute[71206]:   </os>
Jul 27 18:06:27 user nova-compute[71206]:   <features>
Jul 27 18:06:27 user nova-compute[71206]:     <acpi/>
Jul 27 18:06:27 user nova-compute[71206]:     <apic/>
Jul 27 18:06:27 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:06:27 user nova-compute[71206]:   </features>
Jul 27 18:06:27 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:06:27 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:06:27 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:06:27 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:06:27 user nova-compute[71206]:   </clock>
Jul 27 18:06:27 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:06:27 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:06:27 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:06:27 user nova-compute[71206]:   </cpu>
Jul 27 18:06:27 user nova-compute[71206]:   <devices>
Jul 27 18:06:27 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:06:27 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:06:27 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:06:27 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:06:27 user nova-compute[71206]:       <serial>d1a950c8-a3b5-4102-894a-411978408d01</serial>
Jul 27 18:06:27 user nova-compute[71206]:     </disk>
Jul 27 18:06:27 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:06:27 user nova-compute[71206]:       <mac address="fa:16:3e:b4:86:83"/>
Jul 27 18:06:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:06:27 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:06:27 user nova-compute[71206]:       <target dev="tap600425f4-35"/>
Jul 27 18:06:27 user nova-compute[71206]:     </interface>
Jul 27 18:06:27 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:06:27 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/a6dca57e-608c-4778-98ed-4536fa6e3498/console.log" append="off"/>
Jul 27 18:06:27 user nova-compute[71206]:     </serial>
Jul 27 18:06:27 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:06:27 user nova-compute[71206]:     <video>
Jul 27 18:06:27 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:06:27 user nova-compute[71206]:     </video>
Jul 27 18:06:27 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:06:27 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:06:27 user nova-compute[71206]:     </rng>
Jul 27 18:06:27 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:06:27 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:06:27 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:06:27 user nova-compute[71206]:     </memballoon>
Jul 27 18:06:27 user nova-compute[71206]:   </devices>
Jul 27 18:06:27 user nova-compute[71206]: </domain>
Jul 27 18:06:27 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2008976302',display_name='tempest-TestVolumeBootPattern-server-2008976302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2008976302',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-rm8apdl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:06:12Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=a6dca57e-608c-4778-98ed-4536fa6e3498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG os_vif [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap600425f4-35, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap600425f4-35, col_values=(('external_ids', {'iface-id': '600425f4-3543-4803-8fa9-2984ed24c6cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:86:83', 'vm-uuid': 'a6dca57e-608c-4778-98ed-4536fa6e3498'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:27 user nova-compute[71206]: INFO os_vif [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35')
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:06:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:b4:86:83, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] No waiting events found dispatching network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:28 user nova-compute[71206]: WARNING nova.compute.manager [req-aa102aac-56cf-4152-ad39-42bbf41aad22 req-0ef283f8-158b-4a8d-b74b-690dff1e5de9 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received unexpected event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf for instance with vm_state building and task_state spawning.
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481190.690572, a6dca57e-608c-4778-98ed-4536fa6e3498 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] VM Resumed (Lifecycle Event)
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Instance spawned successfully.
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481190.6945734, a6dca57e-608c-4778-98ed-4536fa6e3498 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] VM Started (Lifecycle Event)
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] No waiting events found dispatching network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:30 user nova-compute[71206]: WARNING nova.compute.manager [req-15c7bc47-2226-4ccb-900e-44817904f8fd req-4bea6ff3-2db8-4e34-9985-1baab3f9d7d7 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received unexpected event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf for instance with vm_state building and task_state spawning.
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:30 user nova-compute[71206]: INFO nova.compute.manager [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Took 19.37 seconds to build instance.
Jul 27 18:06:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cad989de-895b-4ba2-afab-7994a4e94133 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.461s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:06:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:34 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:06:34 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.411014556884766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 71cb36ca-6721-4882-b30d-68ae8189e0c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a6dca57e-608c-4778-98ed-4536fa6e3498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:06:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:06:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:44 user nova-compute[71206]: INFO nova.compute.manager [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Terminating instance
Jul 27 18:06:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-unplugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] No waiting events found dispatching network-vif-unplugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-fdd31668-018f-4287-ad0a-ba0955d1d216 req-304b4c38-4453-437d-952d-74a6e8a0b77a service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-unplugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Instance destroyed successfully.
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lazy-loading 'resources' on Instance uuid 764b00ce-48cb-472a-9bcd-0546f6cf3c4c {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-337632116',display_name='tempest-TestServerVolumeAttachmentScenario-server-337632116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-337632116',id=15,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7vHmZugU3Oma8fLl/VXIn7mQqwQ3VqyVUIRDT2vHEWq4bTGSA+0jwNBdhFULKEbdyIgmAuzHC7+31T5MxX40tc5RSLWqT/Mxx7dPDqV0QD3gFRjejMOzxBsarCjBe9BQ==',key_name='tempest-keypair-1414437643',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:02:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83d3c8a7014948aaa46fde6a6c6fd623',ramdisk_id='',reservation_id='r-eeuurb4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-836302792',owner_user_name='tempest-TestServerVolumeAttachmentScenario-836302792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d54156d44349cbb9e2076cf2799bd0',uuid=764b00ce-48cb-472a-9bcd-0546f6cf3c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converting VIF {"id": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "address": "fa:16:3e:77:4c:d7", "network": {"id": "92c843a1-8f3b-4a1e-ba4c-1ebfdd942382", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1709270368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83d3c8a7014948aaa46fde6a6c6fd623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2253410a-aa", "ovs_interfaceid": "2253410a-aa7f-409b-9519-32fcdf1f3bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG os_vif [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2253410a-aa, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:45 user nova-compute[71206]: INFO os_vif [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=2253410a-aa7f-409b-9519-32fcdf1f3bf4,network=Network(92c843a1-8f3b-4a1e-ba4c-1ebfdd942382),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2253410a-aa')
Jul 27 18:06:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Deleting instance files /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c_del
Jul 27 18:06:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Deletion of /opt/stack/data/nova/instances/764b00ce-48cb-472a-9bcd-0546f6cf3c4c_del complete
Jul 27 18:06:45 user nova-compute[71206]: INFO nova.compute.manager [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 18:06:45 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:06:45 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-changed-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing instance network info cache due to event network-changed-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] Acquiring lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] Acquired lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Refreshing network info cache for port d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] Acquiring lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] No waiting events found dispatching network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:46 user nova-compute[71206]: WARNING nova.compute.manager [req-119fb914-e617-482e-a788-add81b103c33 req-790e5b20-57fb-4b99-8230-5c32d4648834 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received unexpected event network-vif-plugged-2253410a-aa7f-409b-9519-32fcdf1f3bf4 for instance with vm_state active and task_state deleting.
Jul 27 18:06:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updated VIF entry in instance network info cache for port d0ea3192-30bd-4db7-9586-8e1c9cc07ce2. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f091fa9f-1854-43c1-bbe6-e8da6e6e9711 req-46eea21b-1a11-443f-a3f3-a588e58f8f9e service nova] Releasing lock "refresh_cache-9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:47 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Took 2.03 seconds to deallocate network for instance.
Jul 27 18:06:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:06:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:48 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Deleted allocations for instance 764b00ce-48cb-472a-9bcd-0546f6cf3c4c
Jul 27 18:06:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-57a0f656-17c0-4073-bd3f-13e82e19b5ec tempest-TestServerVolumeAttachmentScenario-836302792 tempest-TestServerVolumeAttachmentScenario-836302792-project-member] Lock "764b00ce-48cb-472a-9bcd-0546f6cf3c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.483s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-dfa8c839-7368-4229-a60a-e1c1a3c6e7e6 req-bdc0b2ae-a445-438c-b185-b096b8d0cca1 service nova] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Received event network-vif-deleted-2253410a-aa7f-409b-9519-32fcdf1f3bf4 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:49 user nova-compute[71206]: INFO nova.compute.manager [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Terminating instance
Jul 27 18:06:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-9f180015-6da6-4eaa-8768-e5f78f3ca174 req-5658c47a-4111-4ae6-aa60-8841aa7298e5 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-433d8a5d-da42-4961-95bf-ae005e388f24 req-909b6c8d-d0f7-4191-bdf7-7de0eb620c9f service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-1901b7dd-6748-4cae-b9a5-d40673787e68 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-044e2914-7d15-472c-9b7f-402952f7560e req-2dd5aeb2-cfe6-4589-a0c2-993ce23e8ff6 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Instance destroyed successfully.
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lazy-loading 'resources' on Instance uuid 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ea3192-30, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:3f:29,bridge_name='br-int',has_traffic_filtering=True,id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2,network=Network(e964a9d9-ecec-439c-9538-3c87f6181256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea3192-30')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5b7f63f-7b, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:85:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5b7f63f-7b')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f119499-17, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:56:7e,bridge_name='br-int',has_traffic_filtering=True,id=4f119499-17fa-4f7d-b34e-9f0cfa97a389,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4f119499-17')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1901b7dd-67, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6a:67,bridge_name='br-int',has_traffic_filtering=True,id=1901b7dd-6748-4cae-b9a5-d40673787e68,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1901b7dd-67')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dfc42f1-50, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6f:56,bridge_name='br-int',has_traffic_filtering=True,id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed,network=Network(8d398ce6-5f87-453a-9fae-73e96b2fb15a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dfc42f1-50')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c278679-00, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:7a:d6,bridge_name='br-int',has_traffic_filtering=True,id=9c278679-0086-4e45-9072-d85522ce99fc,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c278679-00')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T18:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2119966901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2119966901',id=19,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEOqOUSV8dxkCVFxPsnx6d28deef/k8uzCAkL3YuMgWA4p5xhSZPqM4m5dggTAdZHwi9SjEpqbndDZEgpd6LLL3xw+R4O8T3ujJCyAOSgvBAhpzS+yXagGkQYwdwh8/Uw==',key_name='tempest-keypair-2049581816',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='911738e58ae64e67a9c625ef706e7299',ramdisk_id='',reservation_id='r-dh2wrj3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1545816997',owner_user_name='tempest-TaggedBootDevicesTest-1545816997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e47d920c24f4a93b3efa2a111ec06fd',uuid=9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converting VIF {"id": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "address": "fa:16:3e:f6:11:3f", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fd96e1-98", "ovs_interfaceid": "72fd96e1-984c-46b9-a370-1ff0bfaea923", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fd96e1-98, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:51 user nova-compute[71206]: INFO os_vif [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:11:3f,bridge_name='br-int',has_traffic_filtering=True,id=72fd96e1-984c-46b9-a370-1ff0bfaea923,network=Network(b077ed11-ec88-4144-bd9c-0d42d652a188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fd96e1-98')
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFIhcNGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:51 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eade80-54da-41b2-bb93-06e88052b7e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:06:51 user nova-compute[71206]: No targets found.
Jul 27 18:06:51 user nova-compute[71206]: iSNS:
Jul 27 18:06:51 user nova-compute[71206]: No targets found.
Jul 27 18:06:51 user nova-compute[71206]: STATIC:
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:06:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:51 user nova-compute[71206]: FIRMWARE:
Jul 27 18:06:51 user nova-compute[71206]: No targets found.
Jul 27 18:06:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:06:51 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:06:51 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a040803-ca73-4557-acce-139382411e4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeeeb74-c8bf-4eb5-ae23-16c13cc0c10f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:51 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2d170670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de'): ({'sdj'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Removing single pathed devices sdj {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67881c86-78b7-424c-97e4-2a1598c46616]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b4756-c087-4d87-a4f4-f7fd0c6091d9]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Flushing IO for device /dev/sdj {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54c050d-9bd1-4626-beb7-6c0ddd166527]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:51 user nova-compute[71206]: WARNING nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 for instance with vm_state active and task_state deleting.
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-9c278679-0086-4e45-9072-d85522ce99fc for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:51 user nova-compute[71206]: WARNING nova.compute.manager [req-af60c83e-70e6-4f17-9fa1-f2b2d9251556 req-eba71adb-9f6a-4a2d-ba07-5db1a0909f6a service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9c278679-0086-4e45-9072-d85522ce99fc for instance with vm_state active and task_state deleting.
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[421543a6-c315-4ad9-9012-0bd0942ef2a2]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] SCSI volumes sdj have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf00ad4e-da03-4b26-bcbb-6ad7ca0ef019]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --logout" returned: 0 in 0.108s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b03e14-3623-460a-a8ab-3c6036664e99]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260]
Jul 27 18:06:52 user nova-compute[71206]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de, portal: 172.16.0.220,3260] successful.
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1a206c-38e6-4d2c-88d9-35c7d13721de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d9cc3-86fb-4aec-b5ac-954e8754386b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== disconnect_volume: return (420ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGfmVPhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91b831-88d2-491c-8c7d-fa8d8c6e198b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]: iSNS:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]: STATIC:
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: FIRMWARE:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:06:52 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:06:52 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2de739-af99-4203-8aa0-88539360ff42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d984a45e-9f10-4616-9c6c-390897cd23ed]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2d170430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05'): ({'sdk'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Removing single pathed devices sdk {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da6574-7b13-4d01-961e-0ebf64dd889f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f835a2d-fcaf-45cb-9534-873cb56c9473]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Flushing IO for device /dev/sdk {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aa46e6-5601-4992-9d3a-a1727b683729]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-1901b7dd-6748-4cae-b9a5-d40673787e68 for instance with vm_state active and task_state deleting.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING nova.compute.manager [req-25e8a054-0e0a-4f9c-bb76-8ecee66eb1a2 req-bff0e9a0-031e-460f-9555-b618f6e2e532 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-4f119499-17fa-4f7d-b34e-9f0cfa97a389 for instance with vm_state active and task_state deleting.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d4ff94-a6ab-406a-9b92-91bc1ebb6aab]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] SCSI volumes sdk have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3158144d-9470-4107-9d82-bfa4f626bd12]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8 for instance with vm_state active and task_state deleting.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-9dfc42f1-504a-4a02-a1d7-2647df17d4ed for instance with vm_state active and task_state deleting.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-unplugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-unplugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Acquiring lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] No waiting events found dispatching network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING nova.compute.manager [req-223cf691-fde3-4ff2-9fcc-279f388976b2 req-92f52feb-e623-47a7-913d-d6941d3c4046 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received unexpected event network-vif-plugged-72fd96e1-984c-46b9-a370-1ff0bfaea923 for instance with vm_state active and task_state deleting.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62aa9a-759c-4aa1-bceb-96b974675696]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260]
Jul 27 18:06:52 user nova-compute[71206]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05, portal: 172.16.0.220,3260] successful.
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fe45ecc-f006-4c49-b898-a6e766bc5b05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289334e-64e4-43fd-84d5-129103ec41cc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== disconnect_volume: return (366ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLolsPMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:06:52 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f1dfe-1155-437c-bb33-1a891c0f83ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]: iSNS:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]: STATIC:
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492
Jul 27 18:06:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:06:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:06:52 user nova-compute[71206]: FIRMWARE:
Jul 27 18:06:52 user nova-compute[71206]: No targets found.
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:06:52 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:06:52 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba18653-3aaf-4d1f-986e-99c71932d345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22581855-e68b-4e1b-8552-90bb0f4289d3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:06:52 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c7db640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da7a36-b38a-46ff-8217-bf77056d865f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d848774-a3cd-4601-9024-f1408e1c96e4]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c709c8a5-e4e1-48ca-9549-51fae4017e8c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a032c-131b-4b6a-b565-669f5aa4b114]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39509d2d-d046-4afb-b483-92958931448c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4580e7-deda-40dc-a6db-d4f10643f4ca]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260]
Jul 27 18:06:52 user nova-compute[71206]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492, portal: 172.16.0.220,3260] successful.
Jul 27 18:06:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d86a28a2-7474-445e-93f3-7fbf76a5d492 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea588da3-b5ff-485f-ae33-8050d08c872f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] <== disconnect_volume: return (343ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:06:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Deleting instance files /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb_del
Jul 27 18:06:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Deletion of /opt/stack/data/nova/instances/9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb_del complete
Jul 27 18:06:52 user nova-compute[71206]: INFO nova.compute.manager [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Took 3.62 seconds to destroy the instance on the hypervisor.
Jul 27 18:06:52 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:06:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:06:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-1cb7390d-be0a-4cfb-b198-e8f2ad924b24 req-2fe5be80-5ed0-4589-8084-961f00593f5d service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-deleted-72fd96e1-984c-46b9-a370-1ff0bfaea923 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:54 user nova-compute[71206]: INFO nova.compute.manager [req-1cb7390d-be0a-4cfb-b198-e8f2ad924b24 req-2fe5be80-5ed0-4589-8084-961f00593f5d service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Neutron deleted interface 72fd96e1-984c-46b9-a370-1ff0bfaea923; detaching it from the instance and deleting it from the info cache
Jul 27 18:06:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-1cb7390d-be0a-4cfb-b198-e8f2ad924b24 req-2fe5be80-5ed0-4589-8084-961f00593f5d service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c278679-0086-4e45-9072-d85522ce99fc", "address": "fa:16:3e:84:7a:d6", "network": {"id": "b077ed11-ec88-4144-bd9c-0d42d652a188", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793099729", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c278679-00", "ovs_interfaceid": "9c278679-0086-4e45-9072-d85522ce99fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-1cb7390d-be0a-4cfb-b198-e8f2ad924b24 req-2fe5be80-5ed0-4589-8084-961f00593f5d service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Detach interface failed, port_id=72fd96e1-984c-46b9-a370-1ff0bfaea923, reason: Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:06:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-deleted-9c278679-0086-4e45-9072-d85522ce99fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:56 user nova-compute[71206]: INFO nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Neutron deleted interface 9c278679-0086-4e45-9072-d85522ce99fc; detaching it from the instance and deleting it from the info cache
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.network.neutron [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "address": "fa:16:3e:47:6f:56", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dfc42f1-50", "ovs_interfaceid": "9dfc42f1-504a-4a02-a1d7-2647df17d4ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Detach interface failed, port_id=9c278679-0086-4e45-9072-d85522ce99fc, reason: Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-deleted-9dfc42f1-504a-4a02-a1d7-2647df17d4ed {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:56 user nova-compute[71206]: INFO nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Neutron deleted interface 9dfc42f1-504a-4a02-a1d7-2647df17d4ed; detaching it from the instance and deleting it from the info cache
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.network.neutron [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "address": "fa:16:3e:60:3f:29", "network": {"id": "e964a9d9-ecec-439c-9538-3c87f6181256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-463709617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea3192-30", "ovs_interfaceid": "d0ea3192-30bd-4db7-9586-8e1c9cc07ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Detach interface failed, port_id=9dfc42f1-504a-4a02-a1d7-2647df17d4ed, reason: Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-deleted-d0ea3192-30bd-4db7-9586-8e1c9cc07ce2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:06:56 user nova-compute[71206]: INFO nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Neutron deleted interface d0ea3192-30bd-4db7-9586-8e1c9cc07ce2; detaching it from the instance and deleting it from the info cache
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.network.neutron [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [{"id": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "address": "fa:16:3e:60:85:fc", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b7f63f-7b", "ovs_interfaceid": "f5b7f63f-7bf6-45b6-8e28-caeb1014c3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "address": "fa:16:3e:8a:56:7e", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f119499-17", "ovs_interfaceid": "4f119499-17fa-4f7d-b34e-9f0cfa97a389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1901b7dd-6748-4cae-b9a5-d40673787e68", "address": "fa:16:3e:d4:6a:67", "network": {"id": "8d398ce6-5f87-453a-9fae-73e96b2fb15a", "bridge": "br-int", "label": "tempest-device-tagging-net1-244811058", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "911738e58ae64e67a9c625ef706e7299", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1901b7dd-67", "ovs_interfaceid": "1901b7dd-6748-4cae-b9a5-d40673787e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-20e96e4f-edb5-44c9-933f-5f731ccb8ad4 req-940affd8-45fa-4d08-9d49-d7bf6949ce96 service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Detach interface failed, port_id=d0ea3192-30bd-4db7-9586-8e1c9cc07ce2, reason: Instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:06:57 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:06:57 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Took 4.27 seconds to deallocate network for instance.
Jul 27 18:06:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:06:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-a8477935-c9c5-4639-86d5-7657adaf44f9 req-974cb7b8-57a8-4ac9-b88f-d1a8669309bf service nova] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Received event network-vif-deleted-1901b7dd-6748-4cae-b9a5-d40673787e68 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:00 user nova-compute[71206]: INFO nova.compute.manager [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Took 2.94 seconds to detach 3 volumes for instance.
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481205.3781145, 764b00ce-48cb-472a-9bcd-0546f6cf3c4c => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:00 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] VM Stopped (Lifecycle Event)
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4af0ba59-ba60-4141-aebc-f3cfc9c036eb None None] [instance: 764b00ce-48cb-472a-9bcd-0546f6cf3c4c] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:00 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Deleted allocations for instance 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cddd8875-dba2-4ef9-9569-0051d9a29420 tempest-TaggedBootDevicesTest-1545816997 tempest-TaggedBootDevicesTest-1545816997-project-member] Lock "9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.402s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:07:00 user nova-compute[71206]: INFO nova.compute.claims [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Claim successful on node user
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:07:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:07:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Creating image(s)
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.policy [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fa4ebea12dd4e89b0ae6097aae1bb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f383884701844a8b955177235bbbd4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:01 user nova-compute[71206]: INFO nova.compute.manager [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Terminating instance
Jul 27 18:07:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk 1073741824" returned: 0 in 0.105s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-7e747028-8e27-47ac-aea5-83fdaf123246 req-850930aa-fef7-453f-9087-ef98b5392f03 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-unplugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Cannot resize image /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'migration_context' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Ensure instance console log exists: /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Successfully created port: 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:07:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Instance destroyed successfully.
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lazy-loading 'resources' on Instance uuid 71cb36ca-6721-4882-b30d-68ae8189e0c6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2072367951',display_name='tempest-ServerStableDeviceRescueTest-server-2072367951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2072367951',id=7,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHt6bkycVjKTXxU0uQQUQLsipCybbo5tqpxXIbkmbqimQuV0ZXzMkXaJPa2UkZk+4IB6PDVpRs5r/GPVH50Ktgikwnozo0rO81mXFRR2f2q/WxryWWYYhwq5m//GEqM8A==',key_name='tempest-keypair-71631035',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5df9d3feea7c4d069de51b33ff29ce4b',ramdisk_id='',reservation_id='r-tbob8kt1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1738306522',owner_user_name='tempest-ServerStableDeviceRescueTest-1738306522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e118a0a4fcb49b185eb68e74988195f',uuid=71cb36ca-6721-4882-b30d-68ae8189e0c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converting VIF {"id": "061c4266-2991-4ee7-96f8-ee73173df5fa", "address": "fa:16:3e:ae:41:5b", "network": {"id": "beb04bc2-2d16-4e6b-963a-0ae2f9dee80a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1349350943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5df9d3feea7c4d069de51b33ff29ce4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061c4266-29", "ovs_interfaceid": "061c4266-2991-4ee7-96f8-ee73173df5fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG os_vif [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap061c4266-29, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:02 user nova-compute[71206]: INFO os_vif [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:5b,bridge_name='br-int',has_traffic_filtering=True,id=061c4266-2991-4ee7-96f8-ee73173df5fa,network=Network(beb04bc2-2d16-4e6b-963a-0ae2f9dee80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061c4266-29')
Jul 27 18:07:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Deleting instance files /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6_del
Jul 27 18:07:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Deletion of /opt/stack/data/nova/instances/71cb36ca-6721-4882-b30d-68ae8189e0c6_del complete
Jul 27 18:07:02 user nova-compute[71206]: INFO nova.compute.manager [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 27 18:07:02 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:07:02 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:07:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] Acquiring lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] No waiting events found dispatching network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:04 user nova-compute[71206]: WARNING nova.compute.manager [req-b9473f47-c96b-432d-b705-2702668a095a req-e1dcab04-5d79-490b-9483-bdc603ee694e service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received unexpected event network-vif-plugged-061c4266-2991-4ee7-96f8-ee73173df5fa for instance with vm_state active and task_state deleting.
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Successfully updated port: 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing instance network info cache due to event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:04 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Took 1.85 seconds to deallocate network for instance.
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance network_info: |[{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start _get_guest_xml network_info=[{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:07:04 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:04 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYQ3svvqiTKc7JcEvCAP3gqqCDPyxezA3aJ4J7g4CuxE3HeWVyQ5HA4JaQO5DnXk+S1dOeSgiKH/vyTY2ateEy4NJwEjE84NNEm68eYBuXk4MBfaNrNA06/pm2VGoQ9KQ==',key_name='tempest-keypair-737493504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.objects.instance [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_devices' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:07:04 user nova-compute[71206]:   <uuid>73e7aae9-1e07-448d-b39a-7d37920e3865</uuid>
Jul 27 18:07:04 user nova-compute[71206]:   <name>instance-00000015</name>
Jul 27 18:07:04 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:07:04 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:07:04 user nova-compute[71206]:   <metadata>
Jul 27 18:07:04 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:07:04 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-89295416</nova:name>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:07:04</nova:creationTime>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:07:04 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:07:04 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:owner>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:user uuid="4fa4ebea12dd4e89b0ae6097aae1bb7a">tempest-AttachVolumeShelveTestJSON-760609809-project-member</nova:user>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:project uuid="3f383884701844a8b955177235bbbd4c">tempest-AttachVolumeShelveTestJSON-760609809</nova:project>
Jul 27 18:07:04 user nova-compute[71206]:       </nova:owner>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:07:04 user nova-compute[71206]:       <nova:ports>
Jul 27 18:07:04 user nova-compute[71206]:         <nova:port uuid="4f53b553-dbf5-4873-9894-07f719685b8d">
Jul 27 18:07:04 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:07:04 user nova-compute[71206]:         </nova:port>
Jul 27 18:07:04 user nova-compute[71206]:       </nova:ports>
Jul 27 18:07:04 user nova-compute[71206]:     </nova:instance>
Jul 27 18:07:04 user nova-compute[71206]:   </metadata>
Jul 27 18:07:04 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:07:04 user nova-compute[71206]:     <system>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="serial">73e7aae9-1e07-448d-b39a-7d37920e3865</entry>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="uuid">73e7aae9-1e07-448d-b39a-7d37920e3865</entry>
Jul 27 18:07:04 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:07:04 user nova-compute[71206]:     </system>
Jul 27 18:07:04 user nova-compute[71206]:   </sysinfo>
Jul 27 18:07:04 user nova-compute[71206]:   <os>
Jul 27 18:07:04 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:07:04 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:07:04 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:07:04 user nova-compute[71206]:   </os>
Jul 27 18:07:04 user nova-compute[71206]:   <features>
Jul 27 18:07:04 user nova-compute[71206]:     <acpi/>
Jul 27 18:07:04 user nova-compute[71206]:     <apic/>
Jul 27 18:07:04 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:07:04 user nova-compute[71206]:   </features>
Jul 27 18:07:04 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:07:04 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:07:04 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:07:04 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:07:04 user nova-compute[71206]:   </clock>
Jul 27 18:07:04 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:07:04 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:07:04 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:07:04 user nova-compute[71206]:   </cpu>
Jul 27 18:07:04 user nova-compute[71206]:   <devices>
Jul 27 18:07:04 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:07:04 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:07:04 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk"/>
Jul 27 18:07:04 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:07:04 user nova-compute[71206]:     </disk>
Jul 27 18:07:04 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:07:04 user nova-compute[71206]:       <mac address="fa:16:3e:1b:9a:9c"/>
Jul 27 18:07:04 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:04 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:07:04 user nova-compute[71206]:       <target dev="tap4f53b553-db"/>
Jul 27 18:07:04 user nova-compute[71206]:     </interface>
Jul 27 18:07:04 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:07:04 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/console.log" append="off"/>
Jul 27 18:07:04 user nova-compute[71206]:     </serial>
Jul 27 18:07:04 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:07:04 user nova-compute[71206]:     <video>
Jul 27 18:07:04 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:04 user nova-compute[71206]:     </video>
Jul 27 18:07:04 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:07:04 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:07:04 user nova-compute[71206]:     </rng>
Jul 27 18:07:04 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:07:04 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:07:04 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:07:04 user nova-compute[71206]:     </memballoon>
Jul 27 18:07:04 user nova-compute[71206]:   </devices>
Jul 27 18:07:04 user nova-compute[71206]: </domain>
Jul 27 18:07:04 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYQ3svvqiTKc7JcEvCAP3gqqCDPyxezA3aJ4J7g4CuxE3HeWVyQ5HA4JaQO5DnXk+S1dOeSgiKH/vyTY2ateEy4NJwEjE84NNEm68eYBuXk4MBfaNrNA06/pm2VGoQ9KQ==',key_name='tempest-keypair-737493504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG os_vif [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:07:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f53b553-db, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f53b553-db, col_values=(('external_ids', {'iface-id': '4f53b553-dbf5-4873-9894-07f719685b8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:9a:9c', 'vm-uuid': '73e7aae9-1e07-448d-b39a-7d37920e3865'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:05 user nova-compute[71206]: INFO os_vif [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db')
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No VIF found with MAC fa:16:3e:1b:9a:9c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:05 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Deleted allocations for instance 71cb36ca-6721-4882-b30d-68ae8189e0c6
Jul 27 18:07:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-728c5a2c-5d60-4dce-9f9a-2787959c71ca tempest-ServerStableDeviceRescueTest-1738306522 tempest-ServerStableDeviceRescueTest-1738306522-project-member] Lock "71cb36ca-6721-4882-b30d-68ae8189e0c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updated VIF entry in instance network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9e889c8d-6e7f-4a32-8320-5462466e6260 req-8767adf2-5b02-49f8-93b7-2a160dc02f3f service nova] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481211.2785192, 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:06 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] VM Stopped (Lifecycle Event)
Jul 27 18:07:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-146cd48e-07b3-4270-b2e3-b50098d5837d None None] [instance: 9f9c83c2-10c1-41cd-9f3c-6c9c2d5158cb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-75a9da79-604f-41c0-a239-77ca7f0daa01 req-b8808f5e-4a40-464d-904e-ef73f770bde7 service nova] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Received event network-vif-deleted-061c4266-2991-4ee7-96f8-ee73173df5fa {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481228.4980657, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Resumed (Lifecycle Event)
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance spawned successfully.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481228.4992058, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Started (Lifecycle Event)
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Took 7.04 seconds to spawn the instance on the hypervisor.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:08 user nova-compute[71206]: WARNING nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state building and task_state spawning.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:08 user nova-compute[71206]: WARNING nova.compute.manager [req-feeebaf2-b8e7-4744-987e-e2e080da5806 req-6a0a41b9-b9a8-4623-a4bc-fe6c23de715c service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state building and task_state spawning.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:08 user nova-compute[71206]: INFO nova.compute.manager [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Took 7.82 seconds to build instance.
Jul 27 18:07:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-48544bcb-88fc-4695-b479-dc8148121d71 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.918s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:17 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481222.617237, 71cb36ca-6721-4882-b30d-68ae8189e0c6 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:17 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] VM Stopped (Lifecycle Event)
Jul 27 18:07:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a55d348b-8fd3-465e-bb9b-7877fd8c7e7b None None] [instance: 71cb36ca-6721-4882-b30d-68ae8189e0c6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:07:22 user nova-compute[71206]: INFO nova.compute.claims [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Claim successful on node user
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:07:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.policy [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eabbb175332e41a8b21867f294e13803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bcbc7c97e64b3cbfa2b488963e7ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:07:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Creating image(s)
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "/opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "/opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "/opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk 1073741824" returned: 0 in 0.053s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:07:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Cannot resize image /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'migration_context' on Instance uuid 29c8709b-3c27-4319-a213-b09ea02c8ef2 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Ensure instance console log exists: /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Successfully created port: fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Successfully updated port: fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquired lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-changed-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Refreshing instance network info cache due to event network-changed-fff976c3-ac38-4b84-9427-fe4a9c8b7b40. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:07:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] Acquiring lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updating instance_info_cache with network_info: [{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Releasing lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Instance network_info: |[{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] Acquired lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.neutron [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Refreshing network info cache for port fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Start _get_guest_xml network_info=[{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:07:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2017941253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2017941253',id=22,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkOZCh6gXfCmFzT0wCTE3gtkGPmTkCRsB73xg/VudTt8ICLrYHezkAa7CIfXiLeJJSb2E2pxQJMgsCsaMnCbcQYsrTnAVhjkuY8Zc1tM9vAzpSZZpd1MMvmrwinUnWfXg==',key_name='tempest-keypair-2131516019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-ne9hkwa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=29c8709b-3c27-4319-a213-b09ea02c8ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c8709b-3c27-4319-a213-b09ea02c8ef2 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:07:25 user nova-compute[71206]:   <uuid>29c8709b-3c27-4319-a213-b09ea02c8ef2</uuid>
Jul 27 18:07:25 user nova-compute[71206]:   <name>instance-00000016</name>
Jul 27 18:07:25 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:07:25 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:07:25 user nova-compute[71206]:   <metadata>
Jul 27 18:07:25 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:07:25 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2017941253</nova:name>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:07:25</nova:creationTime>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:07:25 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:07:25 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:owner>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:user uuid="eabbb175332e41a8b21867f294e13803">tempest-ServerActionsV293TestJSON-806702460-project-member</nova:user>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:project uuid="74bcbc7c97e64b3cbfa2b488963e7ed4">tempest-ServerActionsV293TestJSON-806702460</nova:project>
Jul 27 18:07:25 user nova-compute[71206]:       </nova:owner>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:07:25 user nova-compute[71206]:       <nova:ports>
Jul 27 18:07:25 user nova-compute[71206]:         <nova:port uuid="fff976c3-ac38-4b84-9427-fe4a9c8b7b40">
Jul 27 18:07:25 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 18:07:25 user nova-compute[71206]:         </nova:port>
Jul 27 18:07:25 user nova-compute[71206]:       </nova:ports>
Jul 27 18:07:25 user nova-compute[71206]:     </nova:instance>
Jul 27 18:07:25 user nova-compute[71206]:   </metadata>
Jul 27 18:07:25 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:07:25 user nova-compute[71206]:     <system>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="serial">29c8709b-3c27-4319-a213-b09ea02c8ef2</entry>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="uuid">29c8709b-3c27-4319-a213-b09ea02c8ef2</entry>
Jul 27 18:07:25 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:07:25 user nova-compute[71206]:     </system>
Jul 27 18:07:25 user nova-compute[71206]:   </sysinfo>
Jul 27 18:07:25 user nova-compute[71206]:   <os>
Jul 27 18:07:25 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:07:25 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:07:25 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:07:25 user nova-compute[71206]:   </os>
Jul 27 18:07:25 user nova-compute[71206]:   <features>
Jul 27 18:07:25 user nova-compute[71206]:     <acpi/>
Jul 27 18:07:25 user nova-compute[71206]:     <apic/>
Jul 27 18:07:25 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:07:25 user nova-compute[71206]:   </features>
Jul 27 18:07:25 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:07:25 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:07:25 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:07:25 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:07:25 user nova-compute[71206]:   </clock>
Jul 27 18:07:25 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:07:25 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:07:25 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:07:25 user nova-compute[71206]:   </cpu>
Jul 27 18:07:25 user nova-compute[71206]:   <devices>
Jul 27 18:07:25 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:07:25 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:07:25 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk"/>
Jul 27 18:07:25 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:07:25 user nova-compute[71206]:     </disk>
Jul 27 18:07:25 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:07:25 user nova-compute[71206]:       <mac address="fa:16:3e:c0:71:b2"/>
Jul 27 18:07:25 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:25 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:07:25 user nova-compute[71206]:       <target dev="tapfff976c3-ac"/>
Jul 27 18:07:25 user nova-compute[71206]:     </interface>
Jul 27 18:07:25 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:07:25 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/console.log" append="off"/>
Jul 27 18:07:25 user nova-compute[71206]:     </serial>
Jul 27 18:07:25 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:07:25 user nova-compute[71206]:     <video>
Jul 27 18:07:25 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:25 user nova-compute[71206]:     </video>
Jul 27 18:07:25 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:07:25 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:07:25 user nova-compute[71206]:     </rng>
Jul 27 18:07:25 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:07:25 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:07:25 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:07:25 user nova-compute[71206]:     </memballoon>
Jul 27 18:07:25 user nova-compute[71206]:   </devices>
Jul 27 18:07:25 user nova-compute[71206]: </domain>
Jul 27 18:07:25 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2017941253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2017941253',id=22,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkOZCh6gXfCmFzT0wCTE3gtkGPmTkCRsB73xg/VudTt8ICLrYHezkAa7CIfXiLeJJSb2E2pxQJMgsCsaMnCbcQYsrTnAVhjkuY8Zc1tM9vAzpSZZpd1MMvmrwinUnWfXg==',key_name='tempest-keypair-2131516019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-ne9hkwa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=29c8709b-3c27-4319-a213-b09ea02c8ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG os_vif [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfff976c3-ac, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfff976c3-ac, col_values=(('external_ids', {'iface-id': 'fff976c3-ac38-4b84-9427-fe4a9c8b7b40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:71:b2', 'vm-uuid': '29c8709b-3c27-4319-a213-b09ea02c8ef2'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:25 user nova-compute[71206]: INFO os_vif [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac')
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No VIF found with MAC fa:16:3e:c0:71:b2, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.neutron [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updated VIF entry in instance network info cache for port fff976c3-ac38-4b84-9427-fe4a9c8b7b40. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG nova.network.neutron [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updating instance_info_cache with network_info: [{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-905d2abd-01db-4396-8441-8a4b45ec4d76 req-6e4d8c00-3a90-475f-baa7-db54b35fe683 service nova] Releasing lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:07:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] No waiting events found dispatching network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:27 user nova-compute[71206]: WARNING nova.compute.manager [req-414c0226-a89c-4ea0-a5d4-d298822590fe req-3389454f-ba20-4707-8f74-421cca20c161 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received unexpected event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 for instance with vm_state building and task_state spawning.
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481249.144971, 29c8709b-3c27-4319-a213-b09ea02c8ef2 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] VM Resumed (Lifecycle Event)
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Instance spawned successfully.
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481249.146359, 29c8709b-3c27-4319-a213-b09ea02c8ef2 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] VM Started (Lifecycle Event)
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Took 5.88 seconds to spawn the instance on the hypervisor.
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] No waiting events found dispatching network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:29 user nova-compute[71206]: WARNING nova.compute.manager [req-77b93e32-bbae-4307-8a38-8e220db33c53 req-34dac3be-ddbd-43b0-8467-262830e8b099 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received unexpected event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 for instance with vm_state building and task_state spawning.
Jul 27 18:07:29 user nova-compute[71206]: INFO nova.compute.manager [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Took 6.82 seconds to build instance.
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9588510e-be3f-4982-aa7f-66232374c16f tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:07:32 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:32 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:32 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.506698608398438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance db540ca5-3de8-47c3-968d-402bf58f5d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 86884431-10bd-401b-9351-f56a32e82047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a6dca57e-608c-4778-98ed-4536fa6e3498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 73e7aae9-1e07-448d-b39a-7d37920e3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:07:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:07:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:07:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:07:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'info_cache' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:07:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance destroyed successfully.
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'resources' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e52ab25-92, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:07:42 user nova-compute[71206]: INFO os_vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:07:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:07:42 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e8f34-7d5b-4433-bca7-a40e50db9e94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:07:42 user nova-compute[71206]: No targets found.
Jul 27 18:07:42 user nova-compute[71206]: iSNS:
Jul 27 18:07:42 user nova-compute[71206]: No targets found.
Jul 27 18:07:42 user nova-compute[71206]: STATIC:
Jul 27 18:07:42 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01
Jul 27 18:07:42 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:07:42 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:07:42 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:07:42 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:07:42 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:07:42 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:07:42 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:07:42 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:07:42 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:07:42 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:07:42 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:07:42 user nova-compute[71206]: FIRMWARE:
Jul 27 18:07:42 user nova-compute[71206]: No targets found.
Jul 27 18:07:42 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:07:42 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:07:42 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcace2ff-30c9-44a4-a975-06f181ec6dfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55095c86-aa88-447d-a99b-9725ba81397c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:42 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:42 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:42 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e241bcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832'): ({'sdl'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Removing single pathed devices sdl {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ff992-02f7-47d8-bca7-5743a60b6474]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865fe15-6bba-414e-a840-b58276a0c6d9]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flushing IO for device /dev/sdl {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[438384b0-e392-4e23-a341-e060b5484601]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:07:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.044s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c57f1-e5b5-4fff-b7f2-d42dc6530b06]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] SCSI volumes sdl have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27dc1f1-2bbc-44cd-90c7-59e3f31d6ca2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3083de1a-af37-4fe8-8aed-e8985e67ee25]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]
Jul 27 18:07:43 user nova-compute[71206]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc63d15-fbb0-499b-b65f-6ec943e5c912]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== disconnect_volume: return (343ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start _get_guest_xml network_info=[{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '3a1dd61e-9e3b-435c-8628-8c7b670a0ee3', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '7533b699-ec8e-46e4-828e-9cc82c802dce', 'attached_at': '', 'detached_at': '', 'volume_id': '00877c5f-71a0-459f-ade2-d6c988111832', 'serial': '00877c5f-71a0-459f-ade2-d6c988111832'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'numa_topology' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:43 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:43 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:07:43 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:07:43 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:07:43 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bde1129-93a6-4e9f-8447-a4391f3f4205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:07:43 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa52dac-b610-41ef-b05a-6eaa398cc31a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832] added
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41add5-c969-46b7-9a7a-f8eea072d5fc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44558ece-f3db-4179-b94e-6244274f8f1e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQDcdmxn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQDcdmxn" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21da3d1-5b80-4755-b24a-9defd7a38fe0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQDcdmxn'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afaf839-27c5-4bd9-a9b9-4260d810d3a7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead14b33-b1c0-4180-bdfc-021ca6d60ad8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b0f6f6-66d0-49fb-9222-c9b9dd7fbe7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]
Jul 27 18:07:43 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2743662-e067-49f0-8ae7-80328adb304b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56c714-9512-4999-be80-b6400bd67c43]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:07:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:07:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55557106-6e56-4055-bdf7-62b33f3ab2aa]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:07:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23137616663373038', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137616663373038', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'pci_devices' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:07:44 user nova-compute[71206]:   <uuid>7533b699-ec8e-46e4-828e-9cc82c802dce</uuid>
Jul 27 18:07:44 user nova-compute[71206]:   <name>instance-00000011</name>
Jul 27 18:07:44 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:07:44 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:07:44 user nova-compute[71206]:   <metadata>
Jul 27 18:07:44 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:07:44 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1846081917</nova:name>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:07:43</nova:creationTime>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:07:44 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:07:44 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:owner>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:user uuid="faa59a3fcaa042999a5f0c357a5ef42c">tempest-AttachVolumeTestJSON-497623291-project-member</nova:user>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:project uuid="7cd626aa35a645b5b9ce1f5bf9652c79">tempest-AttachVolumeTestJSON-497623291</nova:project>
Jul 27 18:07:44 user nova-compute[71206]:       </nova:owner>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:07:44 user nova-compute[71206]:       <nova:ports>
Jul 27 18:07:44 user nova-compute[71206]:         <nova:port uuid="7e52ab25-92dd-4d48-9037-a402f9f3c98b">
Jul 27 18:07:44 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:07:44 user nova-compute[71206]:         </nova:port>
Jul 27 18:07:44 user nova-compute[71206]:       </nova:ports>
Jul 27 18:07:44 user nova-compute[71206]:     </nova:instance>
Jul 27 18:07:44 user nova-compute[71206]:   </metadata>
Jul 27 18:07:44 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:07:44 user nova-compute[71206]:     <system>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="serial">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="uuid">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:07:44 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:07:44 user nova-compute[71206]:     </system>
Jul 27 18:07:44 user nova-compute[71206]:   </sysinfo>
Jul 27 18:07:44 user nova-compute[71206]:   <os>
Jul 27 18:07:44 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:07:44 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:07:44 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:07:44 user nova-compute[71206]:   </os>
Jul 27 18:07:44 user nova-compute[71206]:   <features>
Jul 27 18:07:44 user nova-compute[71206]:     <acpi/>
Jul 27 18:07:44 user nova-compute[71206]:     <apic/>
Jul 27 18:07:44 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:07:44 user nova-compute[71206]:   </features>
Jul 27 18:07:44 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:07:44 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:07:44 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:07:44 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:07:44 user nova-compute[71206]:   </clock>
Jul 27 18:07:44 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:07:44 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:07:44 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:07:44 user nova-compute[71206]:   </cpu>
Jul 27 18:07:44 user nova-compute[71206]:   <devices>
Jul 27 18:07:44 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:07:44 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:07:44 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk"/>
Jul 27 18:07:44 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:07:44 user nova-compute[71206]:     </disk>
Jul 27 18:07:44 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:07:44 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:07:44 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:07:44 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:07:44 user nova-compute[71206]:       <serial>00877c5f-71a0-459f-ade2-d6c988111832</serial>
Jul 27 18:07:44 user nova-compute[71206]:     </disk>
Jul 27 18:07:44 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:07:44 user nova-compute[71206]:       <mac address="fa:16:3e:97:c1:c7"/>
Jul 27 18:07:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:44 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:07:44 user nova-compute[71206]:       <target dev="tap7e52ab25-92"/>
Jul 27 18:07:44 user nova-compute[71206]:     </interface>
Jul 27 18:07:44 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:07:44 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/console.log" append="off"/>
Jul 27 18:07:44 user nova-compute[71206]:     </serial>
Jul 27 18:07:44 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:07:44 user nova-compute[71206]:     <video>
Jul 27 18:07:44 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:07:44 user nova-compute[71206]:     </video>
Jul 27 18:07:44 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:07:44 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:07:44 user nova-compute[71206]:     </rng>
Jul 27 18:07:44 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:07:44 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:07:44 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:07:44 user nova-compute[71206]:     </memballoon>
Jul 27 18:07:44 user nova-compute[71206]:   </devices>
Jul 27 18:07:44 user nova-compute[71206]: </domain>
Jul 27 18:07:44 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Cannot resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'migration_context' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG os_vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e52ab25-92, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e52ab25-92, col_values=(('external_ids', {'iface-id': '7e52ab25-92dd-4d48-9037-a402f9f3c98b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c1:c7', 'vm-uuid': '7533b699-ec8e-46e4-828e-9cc82c802dce'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:07:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:45 user nova-compute[71206]: INFO os_vif [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:07:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:47 user nova-compute[71206]: WARNING nova.compute.manager [req-1ad1a2fd-4b75-4e11-b75c-d3e90db5fb01 req-48ef44af-37f4-4c9d-8855-0914ad2b7933 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state stopped and task_state powering-on.
Jul 27 18:07:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481269.090666, 7533b699-ec8e-46e4-828e-9cc82c802dce => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:49 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Resumed (Lifecycle Event)
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:07:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance rebooted successfully.
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1c5a1896-0a25-42f6-9f2c-b4dfbf6035a3 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:49 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481269.0944414, 7533b699-ec8e-46e4-828e-9cc82c802dce => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:07:49 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Started (Lifecycle Event)
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:07:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:07:49 user nova-compute[71206]: WARNING nova.compute.manager [req-aa417ce6-53bf-4c66-b8e4-5adc5acde7f0 req-08df51b2-43b1-4854-ba6e-07b7a27bec1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state active and task_state None.
Jul 27 18:07:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:07:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:02 user nova-compute[71206]: INFO nova.compute.manager [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Terminating instance
Jul 27 18:08:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-unplugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] No waiting events found dispatching network-vif-unplugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-26b2de38-d880-4369-945a-c08a6b763f61 req-1b985564-045d-407f-aac5-3fcaa817a5ac service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-unplugged-600425f4-3543-4803-8fa9-2984ed24c6cf for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:08:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Instance destroyed successfully.
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid a6dca57e-608c-4778-98ed-4536fa6e3498 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2008976302',display_name='tempest-TestVolumeBootPattern-server-2008976302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2008976302',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:06:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-rm8apdl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:06:31Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=a6dca57e-608c-4778-98ed-4536fa6e3498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "600425f4-3543-4803-8fa9-2984ed24c6cf", "address": "fa:16:3e:b4:86:83", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600425f4-35", "ovs_interfaceid": "600425f4-3543-4803-8fa9-2984ed24c6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_vif [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap600425f4-35, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:03 user nova-compute[71206]: INFO os_vif [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:86:83,bridge_name='br-int',has_traffic_filtering=True,id=600425f4-3543-4803-8fa9-2984ed24c6cf,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600425f4-35')
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TpJxWeBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:08:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fae63-81b9-46be-9f07-f5624f16afb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:08:03 user nova-compute[71206]: No targets found.
Jul 27 18:08:03 user nova-compute[71206]: iSNS:
Jul 27 18:08:03 user nova-compute[71206]: No targets found.
Jul 27 18:08:03 user nova-compute[71206]: STATIC:
Jul 27 18:08:03 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01
Jul 27 18:08:03 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:03 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:03 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:08:03 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:03 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:03 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:08:03 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:03 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:03 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:08:03 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:03 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:03 user nova-compute[71206]: FIRMWARE:
Jul 27 18:08:03 user nova-compute[71206]: No targets found.
Jul 27 18:08:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:08:03 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:08:03 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[401c02d7-b0b5-495f-8e5c-9caaa37c1440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26ef26-8f76-4c89-8ce1-3f3c3033a1fa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:08:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:08:03 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:08:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e32935000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[430cf923-583d-46dd-aac9-d18536666d7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[119beccb-5f6a-4968-9294-88325a8411aa]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e6e1d-e210-4377-8593-109d619aead8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b1456d-b717-42ee-a4ab-e9ab127413fa]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23961373164316566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1854ef3', '/dev/disk/by-id/scsi-1SCST_BIOd1854ef3-9a71d1ef160a2421') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b2d28-fb5d-4b87-bb33-8a88f7ac2125]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024f8c9-fe0f-4829-a273-3b02e250eec9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b850151-ff93-44b2-b507-308496113cdb]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260]
Jul 27 18:08:03 user nova-compute[71206]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01, portal: 172.16.0.220,3260] successful.
Jul 27 18:08:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a950c8-a3b5-4102-894a-411978408d01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28293b3c-7345-4120-889f-1093778f0555]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (399ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:08:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Deleting instance files /opt/stack/data/nova/instances/a6dca57e-608c-4778-98ed-4536fa6e3498_del
Jul 27 18:08:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Deletion of /opt/stack/data/nova/instances/a6dca57e-608c-4778-98ed-4536fa6e3498_del complete
Jul 27 18:08:03 user nova-compute[71206]: INFO nova.compute.manager [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Took 1.29 seconds to destroy the instance on the hypervisor.
Jul 27 18:08:03 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:08:03 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-bbf4fd23-bcb4-4cbc-ad5c-75ca1c6b8c97 req-6b963e07-d387-4b5c-9c74-3d0ae4f71c05 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-deleted-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:05 user nova-compute[71206]: INFO nova.compute.manager [req-bbf4fd23-bcb4-4cbc-ad5c-75ca1c6b8c97 req-6b963e07-d387-4b5c-9c74-3d0ae4f71c05 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Neutron deleted interface 600425f4-3543-4803-8fa9-2984ed24c6cf; detaching it from the instance and deleting it from the info cache
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-bbf4fd23-bcb4-4cbc-ad5c-75ca1c6b8c97 req-6b963e07-d387-4b5c-9c74-3d0ae4f71c05 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:05 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Took 1.12 seconds to deallocate network for instance.
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-bbf4fd23-bcb4-4cbc-ad5c-75ca1c6b8c97 req-6b963e07-d387-4b5c-9c74-3d0ae4f71c05 service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Detach interface failed, port_id=600425f4-3543-4803-8fa9-2984ed24c6cf, reason: Instance a6dca57e-608c-4778-98ed-4536fa6e3498 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] Acquiring lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] No waiting events found dispatching network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:05 user nova-compute[71206]: WARNING nova.compute.manager [req-3c2b1252-0c3d-401f-abd0-f5a6b58a4af7 req-3538a94e-3350-4e1b-8dec-81343eda2f2b service nova] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Received unexpected event network-vif-plugged-600425f4-3543-4803-8fa9-2984ed24c6cf for instance with vm_state active and task_state deleting.
Jul 27 18:08:06 user nova-compute[71206]: INFO nova.compute.manager [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Took 0.92 seconds to detach 1 volumes for instance.
Jul 27 18:08:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Deleting volume: d1a950c8-a3b5-4102-894a-411978408d01 {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:08:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:06 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:06 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:06 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance a6dca57e-608c-4778-98ed-4536fa6e3498
Jul 27 18:08:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc91623a-c363-41c5-8d65-58cf63a309b6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "a6dca57e-608c-4778-98ed-4536fa6e3498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.085s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:08:09 user nova-compute[71206]: INFO nova.compute.claims [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Claim successful on node user
Jul 27 18:08:09 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:08:10 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:08:10 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Creating image(s)
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "/opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.169s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk 1073741824" returned: 0 in 0.063s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:08:10 user nova-compute[71206]: INFO nova.compute.claims [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Claim successful on node user
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.policy [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ed5535b566e42f195aebce82e14ced7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72bcdbc35df444c99f3d4045832c9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:08:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Cannot resize image /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.objects.instance [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'migration_context' on Instance uuid 33b47dd0-da00-45ae-baa5-7d54f8df84ab {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Ensure instance console log exists: /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:08:11 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:08:11 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Creating image(s)
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.policy [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83503c246a474fb1b1591c82962b7a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3796621f174ee4850f31a657d13792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Successfully created port: 30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk 1073741824" returned: 0 in 0.060s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.157s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Cannot resize image /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Ensure instance console log exists: /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Successfully created port: aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Successfully updated port: 30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-changed-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Refreshing instance network info cache due to event network-changed-30fac421-921c-493d-a42a-dde3e2ad4ef7. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] Acquiring lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updating instance_info_cache with network_info: [{"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Instance network_info: |[{"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] Acquired lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.neutron [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Refreshing network info cache for port 30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Start _get_guest_xml network_info=[{"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:08:14 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:14 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1686647698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1686647698',id=23,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6c08p1gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:10Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=33b47dd0-da00-45ae-baa5-7d54f8df84ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.objects.instance [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b47dd0-da00-45ae-baa5-7d54f8df84ab {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:08:14 user nova-compute[71206]:   <uuid>33b47dd0-da00-45ae-baa5-7d54f8df84ab</uuid>
Jul 27 18:08:14 user nova-compute[71206]:   <name>instance-00000017</name>
Jul 27 18:08:14 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:08:14 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:08:14 user nova-compute[71206]:   <metadata>
Jul 27 18:08:14 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:08:14 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1686647698</nova:name>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:08:14</nova:creationTime>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:08:14 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:08:14 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:owner>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 18:08:14 user nova-compute[71206]:       </nova:owner>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:08:14 user nova-compute[71206]:       <nova:ports>
Jul 27 18:08:14 user nova-compute[71206]:         <nova:port uuid="30fac421-921c-493d-a42a-dde3e2ad4ef7">
Jul 27 18:08:14 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:08:14 user nova-compute[71206]:         </nova:port>
Jul 27 18:08:14 user nova-compute[71206]:       </nova:ports>
Jul 27 18:08:14 user nova-compute[71206]:     </nova:instance>
Jul 27 18:08:14 user nova-compute[71206]:   </metadata>
Jul 27 18:08:14 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:08:14 user nova-compute[71206]:     <system>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="serial">33b47dd0-da00-45ae-baa5-7d54f8df84ab</entry>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="uuid">33b47dd0-da00-45ae-baa5-7d54f8df84ab</entry>
Jul 27 18:08:14 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:08:14 user nova-compute[71206]:     </system>
Jul 27 18:08:14 user nova-compute[71206]:   </sysinfo>
Jul 27 18:08:14 user nova-compute[71206]:   <os>
Jul 27 18:08:14 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:08:14 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:08:14 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:08:14 user nova-compute[71206]:   </os>
Jul 27 18:08:14 user nova-compute[71206]:   <features>
Jul 27 18:08:14 user nova-compute[71206]:     <acpi/>
Jul 27 18:08:14 user nova-compute[71206]:     <apic/>
Jul 27 18:08:14 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:08:14 user nova-compute[71206]:   </features>
Jul 27 18:08:14 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:08:14 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:08:14 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:08:14 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:08:14 user nova-compute[71206]:   </clock>
Jul 27 18:08:14 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:08:14 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:08:14 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:08:14 user nova-compute[71206]:   </cpu>
Jul 27 18:08:14 user nova-compute[71206]:   <devices>
Jul 27 18:08:14 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:08:14 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:08:14 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk"/>
Jul 27 18:08:14 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:08:14 user nova-compute[71206]:     </disk>
Jul 27 18:08:14 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:08:14 user nova-compute[71206]:       <mac address="fa:16:3e:66:20:f1"/>
Jul 27 18:08:14 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:14 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:08:14 user nova-compute[71206]:       <target dev="tap30fac421-92"/>
Jul 27 18:08:14 user nova-compute[71206]:     </interface>
Jul 27 18:08:14 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:08:14 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/console.log" append="off"/>
Jul 27 18:08:14 user nova-compute[71206]:     </serial>
Jul 27 18:08:14 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:08:14 user nova-compute[71206]:     <video>
Jul 27 18:08:14 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:14 user nova-compute[71206]:     </video>
Jul 27 18:08:14 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:08:14 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:08:14 user nova-compute[71206]:     </rng>
Jul 27 18:08:14 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:08:14 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:08:14 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:08:14 user nova-compute[71206]:     </memballoon>
Jul 27 18:08:14 user nova-compute[71206]:   </devices>
Jul 27 18:08:14 user nova-compute[71206]: </domain>
Jul 27 18:08:14 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1686647698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1686647698',id=23,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6c08p1gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:10Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=33b47dd0-da00-45ae-baa5-7d54f8df84ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG os_vif [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fac421-92, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30fac421-92, col_values=(('external_ids', {'iface-id': '30fac421-921c-493d-a42a-dde3e2ad4ef7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:20:f1', 'vm-uuid': '33b47dd0-da00-45ae-baa5-7d54f8df84ab'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:14 user nova-compute[71206]: INFO os_vif [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92')
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:66:20:f1, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Successfully updated port: aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:08:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updated VIF entry in instance network info cache for port 30fac421-921c-493d-a42a-dde3e2ad4ef7. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updating instance_info_cache with network_info: [{"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a3b7a2d9-d764-461a-8ac0-5bb6e2f822d8 req-926f54e8-d80b-4b6b-aff2-9a1f658450dd service nova] Releasing lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance network_info: |[{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start _get_guest_xml network_info=[{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:08:15 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:15 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30620632',display_name='tempest-ServerRescueNegativeTestJSON-server-30620632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30620632',id=24,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCi68c9oO92kRkhNtxabmjvRgJo4PFo88BPP1912YOJNpxv6kprwEW38bqoKHUS7lZ5RBh/UsMFWRhVeQnLE8jnJgxPhwiE+li26bPrj9IjhYuJoudkYoqP0kdcCUbBxA==',key_name='tempest-keypair-1854465445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-4timr004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83503c246a474fb1b1591c82962b7a6c',uuid=0dabbb68-9356-4fed-934e-1aaa4ab46a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:08:15 user nova-compute[71206]:   <uuid>0dabbb68-9356-4fed-934e-1aaa4ab46a4f</uuid>
Jul 27 18:08:15 user nova-compute[71206]:   <name>instance-00000018</name>
Jul 27 18:08:15 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:08:15 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:08:15 user nova-compute[71206]:   <metadata>
Jul 27 18:08:15 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:08:15 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-30620632</nova:name>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:08:15</nova:creationTime>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:08:15 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:08:15 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:owner>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 18:08:15 user nova-compute[71206]:       </nova:owner>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:08:15 user nova-compute[71206]:       <nova:ports>
Jul 27 18:08:15 user nova-compute[71206]:         <nova:port uuid="aeeaca26-bc1b-472f-90b0-766855bf8ea2">
Jul 27 18:08:15 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:08:15 user nova-compute[71206]:         </nova:port>
Jul 27 18:08:15 user nova-compute[71206]:       </nova:ports>
Jul 27 18:08:15 user nova-compute[71206]:     </nova:instance>
Jul 27 18:08:15 user nova-compute[71206]:   </metadata>
Jul 27 18:08:15 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:08:15 user nova-compute[71206]:     <system>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="serial">0dabbb68-9356-4fed-934e-1aaa4ab46a4f</entry>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="uuid">0dabbb68-9356-4fed-934e-1aaa4ab46a4f</entry>
Jul 27 18:08:15 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:08:15 user nova-compute[71206]:     </system>
Jul 27 18:08:15 user nova-compute[71206]:   </sysinfo>
Jul 27 18:08:15 user nova-compute[71206]:   <os>
Jul 27 18:08:15 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:08:15 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:08:15 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:08:15 user nova-compute[71206]:   </os>
Jul 27 18:08:15 user nova-compute[71206]:   <features>
Jul 27 18:08:15 user nova-compute[71206]:     <acpi/>
Jul 27 18:08:15 user nova-compute[71206]:     <apic/>
Jul 27 18:08:15 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:08:15 user nova-compute[71206]:   </features>
Jul 27 18:08:15 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:08:15 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:08:15 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:08:15 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:08:15 user nova-compute[71206]:   </clock>
Jul 27 18:08:15 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:08:15 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:08:15 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:08:15 user nova-compute[71206]:   </cpu>
Jul 27 18:08:15 user nova-compute[71206]:   <devices>
Jul 27 18:08:15 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:08:15 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:08:15 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk"/>
Jul 27 18:08:15 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:08:15 user nova-compute[71206]:     </disk>
Jul 27 18:08:15 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:08:15 user nova-compute[71206]:       <mac address="fa:16:3e:ae:15:b3"/>
Jul 27 18:08:15 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:15 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:08:15 user nova-compute[71206]:       <target dev="tapaeeaca26-bc"/>
Jul 27 18:08:15 user nova-compute[71206]:     </interface>
Jul 27 18:08:15 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:08:15 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/console.log" append="off"/>
Jul 27 18:08:15 user nova-compute[71206]:     </serial>
Jul 27 18:08:15 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:08:15 user nova-compute[71206]:     <video>
Jul 27 18:08:15 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:15 user nova-compute[71206]:     </video>
Jul 27 18:08:15 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:08:15 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:08:15 user nova-compute[71206]:     </rng>
Jul 27 18:08:15 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:08:15 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:08:15 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:08:15 user nova-compute[71206]:     </memballoon>
Jul 27 18:08:15 user nova-compute[71206]:   </devices>
Jul 27 18:08:15 user nova-compute[71206]: </domain>
Jul 27 18:08:15 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30620632',display_name='tempest-ServerRescueNegativeTestJSON-server-30620632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30620632',id=24,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCi68c9oO92kRkhNtxabmjvRgJo4PFo88BPP1912YOJNpxv6kprwEW38bqoKHUS7lZ5RBh/UsMFWRhVeQnLE8jnJgxPhwiE+li26bPrj9IjhYuJoudkYoqP0kdcCUbBxA==',key_name='tempest-keypair-1854465445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-4timr004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83503c246a474fb1b1591c82962b7a6c',uuid=0dabbb68-9356-4fed-934e-1aaa4ab46a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG os_vif [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeeaca26-bc, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaeeaca26-bc, col_values=(('external_ids', {'iface-id': 'aeeaca26-bc1b-472f-90b0-766855bf8ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:15:b3', 'vm-uuid': '0dabbb68-9356-4fed-934e-1aaa4ab46a4f'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:15 user nova-compute[71206]: INFO os_vif [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc')
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:ae:15:b3, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing instance network info cache due to event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:08:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updated VIF entry in instance network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:08:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34554f6a-5564-46fb-9b8a-46b23dd66bad req-b8eec347-af24-4384-af3a-960da67941bc service nova] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] No waiting events found dispatching network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:17 user nova-compute[71206]: WARNING nova.compute.manager [req-1fba80cb-2681-4064-bca3-cea9a3c265ba req-d0787d9f-f388-4060-9d8e-c3a4e06dfaa3 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received unexpected event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 for instance with vm_state building and task_state spawning.
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:18 user nova-compute[71206]: WARNING nova.compute.manager [req-0ad5685c-8480-427b-8708-8c916484a4cf req-475cce85-2a51-4ac9-a5a0-4aa9207ed6cd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state building and task_state spawning.
Jul 27 18:08:18 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481283.4255245, a6dca57e-608c-4778-98ed-4536fa6e3498 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:18 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] VM Stopped (Lifecycle Event)
Jul 27 18:08:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cc39f175-99d3-4846-b8b4-d179f028f14d None None] [instance: a6dca57e-608c-4778-98ed-4536fa6e3498] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] No waiting events found dispatching network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:19 user nova-compute[71206]: WARNING nova.compute.manager [req-a6c0c2d1-2e7b-4b46-96e0-ea9fccafd11f req-3fefc224-0437-41fa-a912-bccd9659ecdf service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received unexpected event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 for instance with vm_state building and task_state spawning.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481300.412479, 33b47dd0-da00-45ae-baa5-7d54f8df84ab => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] VM Resumed (Lifecycle Event)
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Instance spawned successfully.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance spawned successfully.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481300.4127567, 33b47dd0-da00-45ae-baa5-7d54f8df84ab => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] VM Started (Lifecycle Event)
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Took 10.31 seconds to spawn the instance on the hypervisor.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481300.4635825, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Resumed (Lifecycle Event)
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Took 8.98 seconds to spawn the instance on the hypervisor.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:20 user nova-compute[71206]: WARNING nova.compute.manager [req-321a3fb4-3cda-4ff2-b54f-69a1a1d2afe3 req-ec59a3f7-a11b-4639-a719-faf1b305662c service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state building and task_state spawning.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Took 10.07 seconds to build instance.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481300.4637985, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Started (Lifecycle Event)
Jul 27 18:08:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a4a0138f-6d94-4dba-a324-e36ee2b5f6c4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.231s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:20 user nova-compute[71206]: INFO nova.compute.manager [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Took 11.36 seconds to build instance.
Jul 27 18:08:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-91b02b87-c542-4e51-a288-29c119de4b41 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.496s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:21 user nova-compute[71206]: INFO nova.compute.manager [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Terminating instance
Jul 27 18:08:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Instance destroyed successfully.
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lazy-loading 'resources' on Instance uuid 86884431-10bd-401b-9351-f56a32e82047 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1045738722',display_name='tempest-ServerActionsTestOtherB-server-1045738722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1045738722',id=3,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk4JvOS2JWeiZwiSSfHPEt/lgVDs+LZ4YKyN+TmtJWUy2P5TKrAkeeL9ILQB27nZ6eoLMeKMILG5jVHLHSo6LJl5MMV2QdftbdLHuGgzdupQFud9rpP2W4AjK8akXHgiQ==',key_name='tempest-keypair-213117156',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5679fcb6cd0d4b6da2908fbf1d225eec',ramdisk_id='',reservation_id='r-ggqx79my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-86360800',owner_user_name='tempest-ServerActionsTestOtherB-86360800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2e5a1cc2e1c45c9ae97077decdb228e',uuid=86884431-10bd-401b-9351-f56a32e82047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converting VIF {"id": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "address": "fa:16:3e:16:b7:4b", "network": {"id": "89a74848-046c-4766-8e3d-c1647d208345", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-975323224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5679fcb6cd0d4b6da2908fbf1d225eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc85a1c7-e1", "ovs_interfaceid": "cc85a1c7-e1be-4e96-9640-8be9a65a8174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_vif [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc85a1c7-e1, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:22 user nova-compute[71206]: INFO os_vif [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b7:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc85a1c7-e1be-4e96-9640-8be9a65a8174,network=Network(89a74848-046c-4766-8e3d-c1647d208345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc85a1c7-e1')
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXbRKtDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:08:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55df2a8-3d23-487b-8cdf-3b9fcf3e1c69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:08:22 user nova-compute[71206]: No targets found.
Jul 27 18:08:22 user nova-compute[71206]: iSNS:
Jul 27 18:08:22 user nova-compute[71206]: No targets found.
Jul 27 18:08:22 user nova-compute[71206]: STATIC:
Jul 27 18:08:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:08:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212
Jul 27 18:08:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:08:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:08:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:08:22 user nova-compute[71206]: FIRMWARE:
Jul 27 18:08:22 user nova-compute[71206]: No targets found.
Jul 27 18:08:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:08:22 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:08:22 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f010a7-fd86-4d07-b1b7-a7b67d8c0737]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de5926-6c50-4118-a5f1-ab50ec097ebe]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:08:22 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:08:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:08:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 (non-flash)
Jul 27 18:08:22 user nova-compute[71206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:08:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:08:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24264f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5161795d-4752-466c-ac3c-763ab4d43cfd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a28f4-9c76-4f06-8237-2561a583ca33]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7668d050-24f7-4c71-a236-b86b56a2c097]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe3f2b-53e6-4b3b-a0de-f33287ba0163]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[742110fa-6349-4707-8493-29b37c29a636]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29514de0-8e56-48b3-a5c0-8afb692bae11]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260]
Jul 27 18:08:22 user nova-compute[71206]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212, portal: 172.16.0.220,3260] successful.
Jul 27 18:08:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e5616e-97d1-4041-ab14-67fbed459212 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ba7dd-6173-4815-9c42-68cbbc202cb1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] <== disconnect_volume: return (408ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:08:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Deleting instance files /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_del
Jul 27 18:08:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Deletion of /opt/stack/data/nova/instances/86884431-10bd-401b-9351-f56a32e82047_del complete
Jul 27 18:08:22 user nova-compute[71206]: INFO nova.compute.manager [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Took 1.45 seconds to destroy the instance on the hypervisor.
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-unplugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Acquiring lock "86884431-10bd-401b-9351-f56a32e82047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] Lock "86884431-10bd-401b-9351-f56a32e82047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] No waiting events found dispatching network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:22 user nova-compute[71206]: WARNING nova.compute.manager [req-e7b36f4c-249d-46fb-83cc-1f6d1466fa5b req-2c80543e-1cce-4c32-a50a-26708e47c35b service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received unexpected event network-vif-plugged-cc85a1c7-e1be-4e96-9640-8be9a65a8174 for instance with vm_state active and task_state deleting.
Jul 27 18:08:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:23 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:23 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] Took 1.27 seconds to deallocate network for instance.
Jul 27 18:08:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-a20c2d9e-06b0-4764-8448-575b73a613ef req-7ca79aaa-812c-4369-b42f-b24e8ca52ab5 service nova] [instance: 86884431-10bd-401b-9351-f56a32e82047] Received event network-vif-deleted-cc85a1c7-e1be-4e96-9640-8be9a65a8174 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:24 user nova-compute[71206]: INFO nova.compute.manager [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] [instance: 86884431-10bd-401b-9351-f56a32e82047] Took 1.01 seconds to detach 1 volumes for instance.
Jul 27 18:08:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:08:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.647s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.472s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:08:25 user nova-compute[71206]: INFO nova.compute.claims [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Claim successful on node user
Jul 27 18:08:25 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Deleted allocations for instance 86884431-10bd-401b-9351-f56a32e82047
Jul 27 18:08:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4768e086-a042-4cf5-8e37-d50b8b47f34e tempest-ServerActionsTestOtherB-86360800 tempest-ServerActionsTestOtherB-86360800-project-member] Lock "86884431-10bd-401b-9351-f56a32e82047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.652s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:08:26 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.policy [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c1d017cd91d4121b90577b54b28fd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4785a59769df4f2b8e1a027469d25d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:08:26 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Creating image(s)
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk 1073741824" returned: 0 in 0.065s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Cannot resize image /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'migration_context' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Ensure instance console log exists: /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Successfully created port: 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Successfully updated port: 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing instance network info cache due to event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:28 user nova-compute[71206]: INFO nova.compute.manager [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Terminating instance
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance network_info: |[{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start _get_guest_xml network_info=[{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:08:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-853798938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_devices' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:08:29 user nova-compute[71206]:   <uuid>d4764a2f-d9e3-40e9-933f-29374922e420</uuid>
Jul 27 18:08:29 user nova-compute[71206]:   <name>instance-00000019</name>
Jul 27 18:08:29 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:08:29 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:08:29 user nova-compute[71206]:   <metadata>
Jul 27 18:08:29 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:08:29 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherA-server-853798938</nova:name>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:08:29</nova:creationTime>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:08:29 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:08:29 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:owner>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:user uuid="8c1d017cd91d4121b90577b54b28fd89">tempest-ServerActionsTestOtherA-543896870-project-member</nova:user>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:project uuid="4785a59769df4f2b8e1a027469d25d79">tempest-ServerActionsTestOtherA-543896870</nova:project>
Jul 27 18:08:29 user nova-compute[71206]:       </nova:owner>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:08:29 user nova-compute[71206]:       <nova:ports>
Jul 27 18:08:29 user nova-compute[71206]:         <nova:port uuid="397c4c09-e7b6-4e5e-a4e6-36a03f7641ca">
Jul 27 18:08:29 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:08:29 user nova-compute[71206]:         </nova:port>
Jul 27 18:08:29 user nova-compute[71206]:       </nova:ports>
Jul 27 18:08:29 user nova-compute[71206]:     </nova:instance>
Jul 27 18:08:29 user nova-compute[71206]:   </metadata>
Jul 27 18:08:29 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:08:29 user nova-compute[71206]:     <system>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="serial">d4764a2f-d9e3-40e9-933f-29374922e420</entry>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="uuid">d4764a2f-d9e3-40e9-933f-29374922e420</entry>
Jul 27 18:08:29 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:08:29 user nova-compute[71206]:     </system>
Jul 27 18:08:29 user nova-compute[71206]:   </sysinfo>
Jul 27 18:08:29 user nova-compute[71206]:   <os>
Jul 27 18:08:29 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:08:29 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:08:29 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:08:29 user nova-compute[71206]:   </os>
Jul 27 18:08:29 user nova-compute[71206]:   <features>
Jul 27 18:08:29 user nova-compute[71206]:     <acpi/>
Jul 27 18:08:29 user nova-compute[71206]:     <apic/>
Jul 27 18:08:29 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:08:29 user nova-compute[71206]:   </features>
Jul 27 18:08:29 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:08:29 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:08:29 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:08:29 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:08:29 user nova-compute[71206]:   </clock>
Jul 27 18:08:29 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:08:29 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:08:29 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:08:29 user nova-compute[71206]:   </cpu>
Jul 27 18:08:29 user nova-compute[71206]:   <devices>
Jul 27 18:08:29 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:08:29 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:08:29 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk"/>
Jul 27 18:08:29 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:08:29 user nova-compute[71206]:     </disk>
Jul 27 18:08:29 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:08:29 user nova-compute[71206]:       <mac address="fa:16:3e:ea:3f:2d"/>
Jul 27 18:08:29 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:29 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:08:29 user nova-compute[71206]:       <target dev="tap397c4c09-e7"/>
Jul 27 18:08:29 user nova-compute[71206]:     </interface>
Jul 27 18:08:29 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:08:29 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/console.log" append="off"/>
Jul 27 18:08:29 user nova-compute[71206]:     </serial>
Jul 27 18:08:29 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:08:29 user nova-compute[71206]:     <video>
Jul 27 18:08:29 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:08:29 user nova-compute[71206]:     </video>
Jul 27 18:08:29 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:08:29 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:08:29 user nova-compute[71206]:     </rng>
Jul 27 18:08:29 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:08:29 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:08:29 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:08:29 user nova-compute[71206]:     </memballoon>
Jul 27 18:08:29 user nova-compute[71206]:   </devices>
Jul 27 18:08:29 user nova-compute[71206]: </domain>
Jul 27 18:08:29 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-853798938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG os_vif [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397c4c09-e7, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap397c4c09-e7, col_values=(('external_ids', {'iface-id': '397c4c09-e7b6-4e5e-a4e6-36a03f7641ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:3f:2d', 'vm-uuid': 'd4764a2f-d9e3-40e9-933f-29374922e420'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:29 user nova-compute[71206]: INFO os_vif [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7')
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No VIF found with MAC fa:16:3e:ea:3f:2d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updated VIF entry in instance network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8318568-5981-4647-8158-c01386d990e8 req-1311cc50-c218-4574-8c20-66dd5fddacb0 service nova] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:08:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Instance destroyed successfully.
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lazy-loading 'resources' on Instance uuid db540ca5-3de8-47c3-968d-402bf58f5d6f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Skipping network cache update for instance because it is being deleted. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Skipping network cache update for instance because it is Building. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1998307430',display_name='tempest-ServersNegativeTestJSON-server-1998307430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1998307430',id=1,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df66e0d4db9e4423975377161874c03a',ramdisk_id='',reservation_id='r-8woyzh0w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1056680897',owner_user_name='tempest-ServersNegativeTestJSON-1056680897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:59:54Z,user_data=None,user_id='acff3e99b9914903bbc46a86236c161f',uuid=db540ca5-3de8-47c3-968d-402bf58f5d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converting VIF {"id": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "address": "fa:16:3e:c2:18:31", "network": {"id": "8414dde0-8bb3-48a2-bc33-73d46bcc5756", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274682687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df66e0d4db9e4423975377161874c03a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b34c85b-52", "ovs_interfaceid": "8b34c85b-523a-4a6e-acb0-a4863920df9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG os_vif [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b34c85b-52, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:30 user nova-compute[71206]: INFO os_vif [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:18:31,bridge_name='br-int',has_traffic_filtering=True,id=8b34c85b-523a-4a6e-acb0-a4863920df9b,network=Network(8414dde0-8bb3-48a2-bc33-73d46bcc5756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b34c85b-52')
Jul 27 18:08:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Deleting instance files /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f_del
Jul 27 18:08:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Deletion of /opt/stack/data/nova/instances/db540ca5-3de8-47c3-968d-402bf58f5d6f_del complete
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:08:30 user nova-compute[71206]: INFO nova.compute.manager [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Took 1.59 seconds to destroy the instance on the hypervisor.
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-unplugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] No waiting events found dispatching network-vif-unplugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-unplugged-8b34c85b-523a-4a6e-acb0-a4863920df9b for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Acquiring lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] No waiting events found dispatching network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:30 user nova-compute[71206]: WARNING nova.compute.manager [req-930956cd-d190-4ce8-8b1a-1466c64222a0 req-62f67248-d9a9-48af-86af-cfadc71757f1 service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received unexpected event network-vif-plugged-8b34c85b-523a-4a6e-acb0-a4863920df9b for instance with vm_state active and task_state deleting.
Jul 27 18:08:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:31 user nova-compute[71206]: WARNING nova.compute.manager [req-2fce3490-1392-49b8-8362-7f8ac765c7c3 req-632a4c3f-5dcc-426e-8346-70fd40dcb5b4 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state building and task_state spawning.
Jul 27 18:08:31 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Took 1.17 seconds to deallocate network for instance.
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.879s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:32 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Deleted allocations for instance db540ca5-3de8-47c3-968d-402bf58f5d6f
Jul 27 18:08:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf6cb54a-ff0d-4a6d-923d-7017044a2bd5 req-5e243731-0aad-46b7-b5a5-2c7cbc17c6bd service nova] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Received event network-vif-deleted-8b34c85b-523a-4a6e-acb0-a4863920df9b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-21d29749-92a6-4723-9836-e637f331b4e8 tempest-ServersNegativeTestJSON-1056680897 tempest-ServersNegativeTestJSON-1056680897-project-member] Lock "db540ca5-3de8-47c3-968d-402bf58f5d6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.974s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:33 user nova-compute[71206]: WARNING nova.compute.manager [req-819a7890-6ced-4a17-a3c0-a1828f42f62f req-37fb1cb5-30ed-41a1-bc45-05c975482e91 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state building and task_state spawning.
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481313.7197638, d4764a2f-d9e3-40e9-933f-29374922e420 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] VM Resumed (Lifecycle Event)
Jul 27 18:08:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance spawned successfully.
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481313.7391973, d4764a2f-d9e3-40e9-933f-29374922e420 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] VM Started (Lifecycle Event)
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:08:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Took 7.38 seconds to spawn the instance on the hypervisor.
Jul 27 18:08:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:33 user nova-compute[71206]: INFO nova.compute.manager [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Took 8.90 seconds to build instance.
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d31e45c2-8d43-4b80-9902-0f571ca2bbc3 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.156s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:35 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:35 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:08:35 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=25.506214141845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 73e7aae9-1e07-448d-b39a-7d37920e3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:08:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:37 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481302.002155, 86884431-10bd-401b-9351-f56a32e82047 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:37 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 86884431-10bd-401b-9351-f56a32e82047] VM Stopped (Lifecycle Event)
Jul 27 18:08:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-517b6383-6764-430b-b9dc-489beb5180cb None None] [instance: 86884431-10bd-401b-9351-f56a32e82047] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:08:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:45 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481310.2813823, db540ca5-3de8-47c3-968d-402bf58f5d6f => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:08:45 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] VM Stopped (Lifecycle Event)
Jul 27 18:08:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2dbb2f1f-4088-4bd7-88d0-363b0402f39c None None] [instance: db540ca5-3de8-47c3-968d-402bf58f5d6f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:08:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing instance network info cache due to event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:08:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:08:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:53 user nova-compute[71206]: DEBUG nova.network.neutron [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updated VIF entry in instance network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:08:53 user nova-compute[71206]: DEBUG nova.network.neutron [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:08:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-41aaebf0-4f1b-47cf-a43e-028ef039286e req-dbaa2f71-8733-49fd-9dfe-882aeb2c4e9d service nova] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:08:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:58 user nova-compute[71206]: INFO nova.compute.manager [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Shelving
Jul 27 18:08:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:08:59 user nova-compute[71206]: WARNING nova.compute.manager [req-be4f6a9e-3f77-4f9c-9e5a-f13cd934e3cd req-bad38848-2cc0-4098-aaf8-b052aa6b7f1d service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state active and task_state shelving.
Jul 27 18:08:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:08:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance destroyed successfully.
Jul 27 18:08:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Beginning cold snapshot process
Jul 27 18:08:59 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:08:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk /opt/stack/data/nova/instances/snapshots/tmpf5aapgwb/316aabe792cf414bb320de3f16d9a3c6 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk /opt/stack/data/nova/instances/snapshots/tmpf5aapgwb/316aabe792cf414bb320de3f16d9a3c6" returned: 0 in 0.964s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Snapshot extracted, beginning image upload
Jul 27 18:09:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:01 user nova-compute[71206]: WARNING nova.compute.manager [req-add6ea09-89d6-4cd2-81be-7128b13a1f76 req-57527957-81f9-43cf-b4a1-759b24149fa5 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 18:09:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Snapshot image upload complete
Jul 27 18:09:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:03 user nova-compute[71206]: INFO nova.compute.manager [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Shelve offloading
Jul 27 18:09:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance destroyed successfully.
Jul 27 18:09:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:09:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance destroyed successfully.
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'resources' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYQ3svvqiTKc7JcEvCAP3gqqCDPyxezA3aJ4J7g4CuxE3HeWVyQ5HA4JaQO5DnXk+S1dOeSgiKH/vyTY2ateEy4NJwEjE84NNEm68eYBuXk4MBfaNrNA06/pm2VGoQ9KQ==',key_name='tempest-keypair-737493504',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:09:03.645615',shelved_host='user',shelved_image_id='12082a74-1453-4d02-a55e-a8929f1b5f78'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG os_vif [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f53b553-db, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing instance network info cache due to event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:09:05 user nova-compute[71206]: INFO os_vif [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db')
Jul 27 18:09:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Deleting instance files /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865_del
Jul 27 18:09:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Deletion of /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865_del complete
Jul 27 18:09:05 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Deleted allocations for instance 73e7aae9-1e07-448d-b39a-7d37920e3865
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'numa_topology' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updated VIF entry in instance network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4f53b553-db", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-236af7f2-dfc2-4dc0-b8b3-0de34f67c8c0 req-5af9291d-44c2-4804-b611-244cb058dabd service nova] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-58377c07-f7e0-4bcf-b9f8-f13f233c8ba3 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.195s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:06 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:09:06 user nova-compute[71206]: INFO nova.compute.claims [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Claim successful on node user
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:09:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.policy [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dce6f9174404f8ea1acfc078ffbaca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7618aaed15347c7ad497b5676c136eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:09:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Creating image(s)
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "/opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "/opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.170s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk 1073741824" returned: 0 in 0.050s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:09:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Cannot resize image /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'migration_context' on Instance uuid 3e9e993b-fa22-4878-9829-e4be94652975 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Ensure instance console log exists: /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Successfully created port: bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:09:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Successfully updated port: bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquired lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-changed-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Refreshing instance network info cache due to event network-changed-bb25b405-add3-4ebf-997c-a6e991e5a3c9. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] Acquiring lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Updating instance_info_cache with network_info: [{"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Releasing lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Instance network_info: |[{"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] Acquired lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Refreshing network info cache for port bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Start _get_guest_xml network_info=[{"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:09:09 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:09 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1405581447',display_name='tempest-VolumesActionsTest-instance-1405581447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1405581447',id=26,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-0v1adt5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:07Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=3e9e993b-fa22-4878-9829-e4be94652975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e9e993b-fa22-4878-9829-e4be94652975 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:09:09 user nova-compute[71206]:   <uuid>3e9e993b-fa22-4878-9829-e4be94652975</uuid>
Jul 27 18:09:09 user nova-compute[71206]:   <name>instance-0000001a</name>
Jul 27 18:09:09 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:09:09 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:09:09 user nova-compute[71206]:   <metadata>
Jul 27 18:09:09 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:09:09 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:name>tempest-VolumesActionsTest-instance-1405581447</nova:name>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:09:09</nova:creationTime>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:09:09 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:09:09 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:owner>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:user uuid="5dce6f9174404f8ea1acfc078ffbaca9">tempest-VolumesActionsTest-754244769-project-member</nova:user>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:project uuid="b7618aaed15347c7ad497b5676c136eb">tempest-VolumesActionsTest-754244769</nova:project>
Jul 27 18:09:09 user nova-compute[71206]:       </nova:owner>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:09:09 user nova-compute[71206]:       <nova:ports>
Jul 27 18:09:09 user nova-compute[71206]:         <nova:port uuid="bb25b405-add3-4ebf-997c-a6e991e5a3c9">
Jul 27 18:09:09 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:09:09 user nova-compute[71206]:         </nova:port>
Jul 27 18:09:09 user nova-compute[71206]:       </nova:ports>
Jul 27 18:09:09 user nova-compute[71206]:     </nova:instance>
Jul 27 18:09:09 user nova-compute[71206]:   </metadata>
Jul 27 18:09:09 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:09:09 user nova-compute[71206]:     <system>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="serial">3e9e993b-fa22-4878-9829-e4be94652975</entry>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="uuid">3e9e993b-fa22-4878-9829-e4be94652975</entry>
Jul 27 18:09:09 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:09:09 user nova-compute[71206]:     </system>
Jul 27 18:09:09 user nova-compute[71206]:   </sysinfo>
Jul 27 18:09:09 user nova-compute[71206]:   <os>
Jul 27 18:09:09 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:09:09 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:09:09 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:09:09 user nova-compute[71206]:   </os>
Jul 27 18:09:09 user nova-compute[71206]:   <features>
Jul 27 18:09:09 user nova-compute[71206]:     <acpi/>
Jul 27 18:09:09 user nova-compute[71206]:     <apic/>
Jul 27 18:09:09 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:09:09 user nova-compute[71206]:   </features>
Jul 27 18:09:09 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:09:09 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:09:09 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:09:09 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:09:09 user nova-compute[71206]:   </clock>
Jul 27 18:09:09 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:09:09 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:09:09 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:09:09 user nova-compute[71206]:   </cpu>
Jul 27 18:09:09 user nova-compute[71206]:   <devices>
Jul 27 18:09:09 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:09:09 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:09:09 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk"/>
Jul 27 18:09:09 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:09:09 user nova-compute[71206]:     </disk>
Jul 27 18:09:09 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:09:09 user nova-compute[71206]:       <mac address="fa:16:3e:52:28:4a"/>
Jul 27 18:09:09 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:09 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:09:09 user nova-compute[71206]:       <target dev="tapbb25b405-ad"/>
Jul 27 18:09:09 user nova-compute[71206]:     </interface>
Jul 27 18:09:09 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:09:09 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/console.log" append="off"/>
Jul 27 18:09:09 user nova-compute[71206]:     </serial>
Jul 27 18:09:09 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:09:09 user nova-compute[71206]:     <video>
Jul 27 18:09:09 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:09 user nova-compute[71206]:     </video>
Jul 27 18:09:09 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:09:09 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:09:09 user nova-compute[71206]:     </rng>
Jul 27 18:09:09 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:09:09 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:09:09 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:09:09 user nova-compute[71206]:     </memballoon>
Jul 27 18:09:09 user nova-compute[71206]:   </devices>
Jul 27 18:09:09 user nova-compute[71206]: </domain>
Jul 27 18:09:09 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1405581447',display_name='tempest-VolumesActionsTest-instance-1405581447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1405581447',id=26,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-0v1adt5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:07Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=3e9e993b-fa22-4878-9829-e4be94652975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG os_vif [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb25b405-ad, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb25b405-ad, col_values=(('external_ids', {'iface-id': 'bb25b405-add3-4ebf-997c-a6e991e5a3c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:28:4a', 'vm-uuid': '3e9e993b-fa22-4878-9829-e4be94652975'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:09 user nova-compute[71206]: INFO os_vif [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad')
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:09:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] No VIF found with MAC fa:16:3e:52:28:4a, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:09:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Updated VIF entry in instance network info cache for port bb25b405-add3-4ebf-997c-a6e991e5a3c9. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:09:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Updating instance_info_cache with network_info: [{"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3449bb89-edfa-4747-b7f5-82586fe97e0b req-14c66d3c-1ecd-4ad3-9767-55b794a4acc7 service nova] Releasing lock "refresh_cache-3e9e993b-fa22-4878-9829-e4be94652975" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:11 user nova-compute[71206]: WARNING nova.compute.manager [req-56d460e8-aecc-4cdc-ab8a-15f127e793c1 req-9e0cde74-0758-428b-a227-aa76633f9413 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state building and task_state spawning.
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:12 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:09:12 user nova-compute[71206]: INFO nova.compute.claims [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Claim successful on node user
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.policy [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481353.5817132, 3e9e993b-fa22-4878-9829-e4be94652975 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] VM Resumed (Lifecycle Event)
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Instance spawned successfully.
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.virt.block_device [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Booting with volume dc6c7f32-c640-4c06-9581-0d04a2402ac1 at /dev/vda
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:13 user nova-compute[71206]: WARNING nova.compute.manager [req-9259af34-0ae7-479b-8272-676234b807d0 req-ddbd9c31-7be1-4a49-9ad6-5c690b4786ab service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state building and task_state spawning.
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481353.5839658, 3e9e993b-fa22-4878-9829-e4be94652975 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] VM Started (Lifecycle Event)
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.utils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398f010-c2ff-44f0-a621-d47a95bba84e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61720fa2-d53e-42bb-9fbe-ae34d2382025]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:13 user nova-compute[71206]: INFO nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Took 6.47 seconds to spawn the instance on the hypervisor.
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d95e8-46e7-4323-8b86-46b28d44dd6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[deab690a-364f-4ce1-8703-eb226d215613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:09:13 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:09:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1dff74-6276-4080-b084-12b8cfd1a139]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG os_brick.utils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:09:13 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updating existing volume attachment record: b0ba7f8a-0557-4247-ac68-73bbcb085f36 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:09:14 user nova-compute[71206]: INFO nova.compute.manager [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Took 7.38 seconds to build instance.
Jul 27 18:09:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-43c3763b-a649-4e2c-8927-5aaf08a840ea tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Successfully created port: 72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:09:14 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481339.3162737, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:14 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Stopped (Lifecycle Event)
Jul 27 18:09:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6838c53a-7d19-4230-9a02-2e4dbd715add None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Successfully updated port: 72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-changed-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Refreshing instance network info cache due to event network-changed-72e05315-8617-459d-af5a-aed58e28fcfe. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] Acquiring lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-changed-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Refreshing instance network info cache due to event network-changed-fff976c3-ac38-4b84-9427-fe4a9c8b7b40. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] Acquiring lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] Acquired lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Refreshing network info cache for port fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updating instance_info_cache with network_info: [{"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Instance network_info: |[{"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] Acquired lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Refreshing network info cache for port 72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updated VIF entry in instance network info cache for port fff976c3-ac38-4b84-9427-fe4a9c8b7b40. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updating instance_info_cache with network_info: [{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3c13169c-5c5c-44f0-8e8b-71fa4e479726 req-9d949008-1494-41b5-b2a7-3ec97389405c service nova] Releasing lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updated VIF entry in instance network info cache for port 72e05315-8617-459d-af5a-aed58e28fcfe. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updating instance_info_cache with network_info: [{"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-877128ca-8500-4821-98dc-b23c440ce83d req-896090ca-5e24-48b3-8035-17b6fb0fbca1 service nova] Releasing lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:09:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Creating image(s)
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Ensure instance console log exists: /opt/stack/data/nova/instances/ccb00f08-4894-41f6-816f-2683b5e7315d/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Start _get_guest_xml network_info=[{"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'b0ba7f8a-0557-4247-ac68-73bbcb085f36', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MukGByAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccb00f08-4894-41f6-816f-2683b5e7315d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc6c7f32-c640-4c06-9581-0d04a2402ac1', 'serial': 'dc6c7f32-c640-4c06-9581-0d04a2402ac1'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:09:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MukGByAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:09:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:09:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:09:22 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b3eda-25ed-4770-9b5d-542d3d10b6e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:09:22 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60041f6-e311-4a68-b034-0f29eb2bbd9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1] added
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f19abb3-a903-44c1-92f2-7b76f85eae9c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2bd54c-7150-43d4-971e-5105527de08d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MukGByAO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MukGByAO" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dcdeb0-e2c7-4705-ba80-a6e71861a624]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MukGByAO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97baf2-a113-4fd1-937a-8439eed900a6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ea712-8e4b-4395-9be6-16416cccc52a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad215d6a-b1ea-4c60-be93-8d26b6dc13f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260]
Jul 27 18:09:22 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260] successful.
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a155c-5a43-43bf-8d6b-abf17bde6891]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3eeb15-5605-44f3-a1c2-a9654d29be6a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d08c05-8c8d-4159-8136-3161f9d4a91d]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:09:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MukGByAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26137633262373937', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137633262373937', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-179221980',display_name='tempest-TestVolumeBootPattern-volume-backed-server-179221980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-179221980',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8e8pxkEL6Gap48apm/d3MHo/7Y2ivRkUqHlvZADckelgGD69Y3jjM/i0BrALPZ0q01bTFg3WLqWZRvrO+/7allBoXEkFRuvdBqyxfj1t+oIbXN/CBtdlA7MnF4WSr0Q==',key_name='tempest-keypair-344601941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-ynedcth7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=ccb00f08-4894-41f6-816f-2683b5e7315d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid ccb00f08-4894-41f6-816f-2683b5e7315d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:09:23 user nova-compute[71206]:   <uuid>ccb00f08-4894-41f6-816f-2683b5e7315d</uuid>
Jul 27 18:09:23 user nova-compute[71206]:   <name>instance-0000001b</name>
Jul 27 18:09:23 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:09:23 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:09:23 user nova-compute[71206]:   <metadata>
Jul 27 18:09:23 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:09:23 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:09:23 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-179221980</nova:name>
Jul 27 18:09:23 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:09:22</nova:creationTime>
Jul 27 18:09:23 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:09:23 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:09:23 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:09:23 user nova-compute[71206]:       <nova:owner>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:09:23 user nova-compute[71206]:       </nova:owner>
Jul 27 18:09:23 user nova-compute[71206]:       <nova:ports>
Jul 27 18:09:23 user nova-compute[71206]:         <nova:port uuid="72e05315-8617-459d-af5a-aed58e28fcfe">
Jul 27 18:09:23 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:09:23 user nova-compute[71206]:         </nova:port>
Jul 27 18:09:23 user nova-compute[71206]:       </nova:ports>
Jul 27 18:09:23 user nova-compute[71206]:     </nova:instance>
Jul 27 18:09:23 user nova-compute[71206]:   </metadata>
Jul 27 18:09:23 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:09:23 user nova-compute[71206]:     <system>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="serial">ccb00f08-4894-41f6-816f-2683b5e7315d</entry>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="uuid">ccb00f08-4894-41f6-816f-2683b5e7315d</entry>
Jul 27 18:09:23 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:09:23 user nova-compute[71206]:     </system>
Jul 27 18:09:23 user nova-compute[71206]:   </sysinfo>
Jul 27 18:09:23 user nova-compute[71206]:   <os>
Jul 27 18:09:23 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:09:23 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:09:23 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:09:23 user nova-compute[71206]:   </os>
Jul 27 18:09:23 user nova-compute[71206]:   <features>
Jul 27 18:09:23 user nova-compute[71206]:     <acpi/>
Jul 27 18:09:23 user nova-compute[71206]:     <apic/>
Jul 27 18:09:23 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:09:23 user nova-compute[71206]:   </features>
Jul 27 18:09:23 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:09:23 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:09:23 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:09:23 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:09:23 user nova-compute[71206]:   </clock>
Jul 27 18:09:23 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:09:23 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:09:23 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:09:23 user nova-compute[71206]:   </cpu>
Jul 27 18:09:23 user nova-compute[71206]:   <devices>
Jul 27 18:09:23 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:09:23 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:09:23 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:09:23 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:09:23 user nova-compute[71206]:       <serial>dc6c7f32-c640-4c06-9581-0d04a2402ac1</serial>
Jul 27 18:09:23 user nova-compute[71206]:     </disk>
Jul 27 18:09:23 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:09:23 user nova-compute[71206]:       <mac address="fa:16:3e:c7:5c:7c"/>
Jul 27 18:09:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:23 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:09:23 user nova-compute[71206]:       <target dev="tap72e05315-86"/>
Jul 27 18:09:23 user nova-compute[71206]:     </interface>
Jul 27 18:09:23 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:09:23 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/ccb00f08-4894-41f6-816f-2683b5e7315d/console.log" append="off"/>
Jul 27 18:09:23 user nova-compute[71206]:     </serial>
Jul 27 18:09:23 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:09:23 user nova-compute[71206]:     <video>
Jul 27 18:09:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:23 user nova-compute[71206]:     </video>
Jul 27 18:09:23 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:09:23 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:09:23 user nova-compute[71206]:     </rng>
Jul 27 18:09:23 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:09:23 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:09:23 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:09:23 user nova-compute[71206]:     </memballoon>
Jul 27 18:09:23 user nova-compute[71206]:   </devices>
Jul 27 18:09:23 user nova-compute[71206]: </domain>
Jul 27 18:09:23 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-179221980',display_name='tempest-TestVolumeBootPattern-volume-backed-server-179221980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-179221980',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8e8pxkEL6Gap48apm/d3MHo/7Y2ivRkUqHlvZADckelgGD69Y3jjM/i0BrALPZ0q01bTFg3WLqWZRvrO+/7allBoXEkFRuvdBqyxfj1t+oIbXN/CBtdlA7MnF4WSr0Q==',key_name='tempest-keypair-344601941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-ynedcth7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=ccb00f08-4894-41f6-816f-2683b5e7315d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG os_vif [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72e05315-86, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72e05315-86, col_values=(('external_ids', {'iface-id': '72e05315-8617-459d-af5a-aed58e28fcfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:5c:7c', 'vm-uuid': 'ccb00f08-4894-41f6-816f-2683b5e7315d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:23 user nova-compute[71206]: INFO os_vif [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86')
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:09:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:c7:5c:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:09:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:09:25 user nova-compute[71206]: INFO nova.compute.claims [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Claim successful on node user
Jul 27 18:09:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] No waiting events found dispatching network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:25 user nova-compute[71206]: WARNING nova.compute.manager [req-1aaa73f0-a0d6-4af5-a252-fd871484546f req-aaf4a634-72f7-4b34-8282-e944102ce20b service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received unexpected event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe for instance with vm_state building and task_state spawning.
Jul 27 18:09:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:09:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:09:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:09:25 user nova-compute[71206]: INFO nova.virt.block_device [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Booting with volume c431fc05-bf9b-4ffd-853e-2bc6c260b555 at /dev/vda
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.utils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG nova.policy [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eabbb175332e41a8b21867f294e13803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bcbc7c97e64b3cbfa2b488963e7ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34098e32-4fe1-4333-a24b-2b4facbe715b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fce997d-4b8f-44e3-9c20-3d9c3b4cb3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99211d1-a46c-4b95-9cad-f61a9fd9bd81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb32e34-ea31-4419-ad08-c2d1a62a543d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:09:26 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:09:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed4ccf8-b4f7-4fb3-ad9a-9cb0d3ee8d0b]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG os_brick.utils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:09:26 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating existing volume attachment record: 3edb7a44-7c5c-457d-9686-f38e9dc51f75 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Successfully created port: ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481367.6617026, ccb00f08-4894-41f6-816f-2683b5e7315d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] VM Resumed (Lifecycle Event)
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Instance spawned successfully.
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] No waiting events found dispatching network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:27 user nova-compute[71206]: WARNING nova.compute.manager [req-1af8d67b-bfa7-49e8-a9eb-df389047cb8e req-aabb080f-f32a-4803-b48c-0bd1bc3c12db service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received unexpected event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe for instance with vm_state building and task_state spawning.
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481367.6692872, ccb00f08-4894-41f6-816f-2683b5e7315d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] VM Started (Lifecycle Event)
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:27 user nova-compute[71206]: INFO nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Took 5.49 seconds to spawn the instance on the hypervisor.
Jul 27 18:09:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Successfully updated port: ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:09:28 user nova-compute[71206]: INFO nova.compute.manager [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Took 15.41 seconds to build instance.
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquired lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-331e383d-0cb8-42b0-9a67-f9f2ef0f06b4 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.519s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating instance_info_cache with network_info: [{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Releasing lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance network_info: |[{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-changed-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Refreshing instance network info cache due to event network-changed-ba625d39-b403-4879-890b-b86da4fbdce6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:09:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] Acquiring lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] Acquired lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Refreshing network info cache for port ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updated VIF entry in instance network info cache for port ba625d39-b403-4879-890b-b86da4fbdce6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating instance_info_cache with network_info: [{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-474fc156-262c-4d18-8f3e-19143b235caf req-9b53112b-eea8-4aee-987b-fc1e98f78052 service nova] Releasing lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [{"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-7824a157-7697-4e8a-a212-201cf29cb062" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:30 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:33 user nova-compute[71206]: INFO nova.compute.manager [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Detaching volume 00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:33 user nova-compute[71206]: INFO nova.virt.block_device [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Attempting to driver detach volume 00877c5f-71a0-459f-ade2-d6c988111832 from mountpoint /dev/vdb
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Attempting to detach device vdb from instance 7533b699-ec8e-46e4-828e-9cc82c802dce from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:09:34 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:09:34 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:09:34 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:09:34 user nova-compute[71206]:   <serial>00877c5f-71a0-459f-ade2-d6c988111832</serial>
Jul 27 18:09:34 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:09:34 user nova-compute[71206]: </disk>
Jul 27 18:09:34 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:09:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdb from instance 7533b699-ec8e-46e4-828e-9cc82c802dce from the persistent domain config.
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7533b699-ec8e-46e4-828e-9cc82c802dce from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:09:34 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:09:34 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:09:34 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:09:34 user nova-compute[71206]:   <serial>00877c5f-71a0-459f-ade2-d6c988111832</serial>
Jul 27 18:09:34 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:09:34 user nova-compute[71206]: </disk>
Jul 27 18:09:34 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481374.501987, 7533b699-ec8e-46e4-828e-9cc82c802dce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdb from instance 7533b699-ec8e-46e4-828e-9cc82c802dce from the live domain config.
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQDcdmxn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:09:34 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c74d2be-165d-42ab-bf34-03efbea1a960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:09:34 user nova-compute[71206]: No targets found.
Jul 27 18:09:34 user nova-compute[71206]: iSNS:
Jul 27 18:09:34 user nova-compute[71206]: No targets found.
Jul 27 18:09:34 user nova-compute[71206]: STATIC:
Jul 27 18:09:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:09:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:09:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:09:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832
Jul 27 18:09:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:09:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:09:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:09:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:09:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:09:34 user nova-compute[71206]: FIRMWARE:
Jul 27 18:09:34 user nova-compute[71206]: No targets found.
Jul 27 18:09:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:09:34 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:09:34 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f05307-6a50-4906-a0f1-cc7b68898f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:09:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Creating image(s)
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Ensure instance console log exists: /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start _get_guest_xml network_info=[{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '3edb7a44-7c5c-457d-9686-f38e9dc51f75', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f6ee1d9-26cc-483e-b880-32b74f8a75f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'serial': 'c431fc05-bf9b-4ffd-853e-2bc6c260b555'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1c5069-a786-4048-a352-d70267fca7fe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:34 user nova-compute[71206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 (non-flash)
Jul 27 18:09:34 user nova-compute[71206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24325f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:34 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:09:34 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1159f4d3-0ce4-4f19-890e-869e12d39b5a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244e801-b768-4fa4-b20d-5b6a9fbc711f]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d48c6-fd9b-4551-a755-660db5f40409]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce68c9-297a-4efd-8903-51ed60cdd837]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a79758-f485-4564-8d90-e4220754a8d2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd0ce3b-c9be-4592-a352-2fb649a54b07]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260]
Jul 27 18:09:34 user nova-compute[71206]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832, portal: 172.16.0.220,3260] successful.
Jul 27 18:09:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00877c5f-71a0-459f-ade2-d6c988111832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c84be-e9bd-44d2-a053-da6375a72a66]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== disconnect_volume: return (445ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.263s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:09:35 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:09:35 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296fd54-47a5-473d-a23d-d7339888322a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:09:35 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e677d6a-a4b8-4516-9e4f-68e3d915d9e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555] added
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.155s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec26e4b-9b4d-4f81-a0a6-1f0eba1b8179]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf147a-ea1f-4852-a3b5-a15430fd8dfd]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlNIidrp {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlNIidrp" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fc86f9-c4eb-44dd-ae1c-cbbcd2488441]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vlNIidrp'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1db8a-2470-442e-854a-3aa058a0a2d7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a91cd5-8ebd-4c0a-b714-8469bc0b79ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[665466eb-b398-4043-8823-d6eb490e7472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]
Jul 27 18:09:35 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13834080-db8b-4158-a380-b3dfabeb29a8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f05fe-2621-4986-8400-05bdf38506f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:09:35 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:09:35 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c3d4de-7ed4-4411-9d2c-d2efcb62f6db]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG nova.objects.instance [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-188aa5fd-7412-4028-99d5-9cfa8aeb458f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.374s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.796s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== connect_volume: return (2061ms) {'type': 'block', 'scsi_wwn': '23765613462326338', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613462326338', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:09:36 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:36 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7288MB free_disk=25.35120391845703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1822567350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.objects.instance [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:09:36 user nova-compute[71206]:   <uuid>8f6ee1d9-26cc-483e-b880-32b74f8a75f4</uuid>
Jul 27 18:09:36 user nova-compute[71206]:   <name>instance-0000001c</name>
Jul 27 18:09:36 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:09:36 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:09:36 user nova-compute[71206]:   <metadata>
Jul 27 18:09:36 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:09:36 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:09:36 user nova-compute[71206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1822567350</nova:name>
Jul 27 18:09:36 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:09:34</nova:creationTime>
Jul 27 18:09:36 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:09:36 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:09:36 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:09:36 user nova-compute[71206]:       <nova:owner>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:user uuid="eabbb175332e41a8b21867f294e13803">tempest-ServerActionsV293TestJSON-806702460-project-member</nova:user>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:project uuid="74bcbc7c97e64b3cbfa2b488963e7ed4">tempest-ServerActionsV293TestJSON-806702460</nova:project>
Jul 27 18:09:36 user nova-compute[71206]:       </nova:owner>
Jul 27 18:09:36 user nova-compute[71206]:       <nova:ports>
Jul 27 18:09:36 user nova-compute[71206]:         <nova:port uuid="ba625d39-b403-4879-890b-b86da4fbdce6">
Jul 27 18:09:36 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 18:09:36 user nova-compute[71206]:         </nova:port>
Jul 27 18:09:36 user nova-compute[71206]:       </nova:ports>
Jul 27 18:09:36 user nova-compute[71206]:     </nova:instance>
Jul 27 18:09:36 user nova-compute[71206]:   </metadata>
Jul 27 18:09:36 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:09:36 user nova-compute[71206]:     <system>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="serial">8f6ee1d9-26cc-483e-b880-32b74f8a75f4</entry>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="uuid">8f6ee1d9-26cc-483e-b880-32b74f8a75f4</entry>
Jul 27 18:09:36 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:09:36 user nova-compute[71206]:     </system>
Jul 27 18:09:36 user nova-compute[71206]:   </sysinfo>
Jul 27 18:09:36 user nova-compute[71206]:   <os>
Jul 27 18:09:36 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:09:36 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:09:36 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:09:36 user nova-compute[71206]:   </os>
Jul 27 18:09:36 user nova-compute[71206]:   <features>
Jul 27 18:09:36 user nova-compute[71206]:     <acpi/>
Jul 27 18:09:36 user nova-compute[71206]:     <apic/>
Jul 27 18:09:36 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:09:36 user nova-compute[71206]:   </features>
Jul 27 18:09:36 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:09:36 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:09:36 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:09:36 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:09:36 user nova-compute[71206]:   </clock>
Jul 27 18:09:36 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:09:36 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:09:36 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:09:36 user nova-compute[71206]:   </cpu>
Jul 27 18:09:36 user nova-compute[71206]:   <devices>
Jul 27 18:09:36 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:09:36 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:09:36 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:09:36 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:09:36 user nova-compute[71206]:       <serial>c431fc05-bf9b-4ffd-853e-2bc6c260b555</serial>
Jul 27 18:09:36 user nova-compute[71206]:     </disk>
Jul 27 18:09:36 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:09:36 user nova-compute[71206]:       <mac address="fa:16:3e:9b:ff:a3"/>
Jul 27 18:09:36 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:36 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:09:36 user nova-compute[71206]:       <target dev="tapba625d39-b4"/>
Jul 27 18:09:36 user nova-compute[71206]:     </interface>
Jul 27 18:09:36 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:09:36 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4/console.log" append="off"/>
Jul 27 18:09:36 user nova-compute[71206]:     </serial>
Jul 27 18:09:36 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:09:36 user nova-compute[71206]:     <video>
Jul 27 18:09:36 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:09:36 user nova-compute[71206]:     </video>
Jul 27 18:09:36 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:09:36 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:09:36 user nova-compute[71206]:     </rng>
Jul 27 18:09:36 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:09:36 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:09:36 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:09:36 user nova-compute[71206]:     </memballoon>
Jul 27 18:09:36 user nova-compute[71206]:   </devices>
Jul 27 18:09:36 user nova-compute[71206]: </domain>
Jul 27 18:09:36 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1822567350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG os_vif [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba625d39-b4, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba625d39-b4, col_values=(('external_ids', {'iface-id': 'ba625d39-b403-4879-890b-b86da4fbdce6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:ff:a3', 'vm-uuid': '8f6ee1d9-26cc-483e-b880-32b74f8a75f4'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:09:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:36 user nova-compute[71206]: INFO os_vif [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4')
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No VIF found with MAC fa:16:3e:9b:ff:a3, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3e9e993b-fa22-4878-9829-e4be94652975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ccb00f08-4894-41f6-816f-2683b5e7315d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.objects.instance [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:37 user nova-compute[71206]: WARNING nova.compute.manager [req-c39fc132-548a-47dc-91de-7e15a74da44f req-9008085c-beef-4bb9-994d-6a3e124ae64b service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state active and task_state powering-off.
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:09:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.884s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:38 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance destroyed successfully.
Jul 27 18:09:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-976de621-9f16-43ca-bc82-1b24bb3f773c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.695s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:39 user nova-compute[71206]: WARNING nova.compute.manager [req-ae8f9e4d-83ba-4ca9-b4e6-036ee07c0e74 req-ef7dfdf1-e792-41b0-8d64-4ffdacfb5a31 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state building and task_state spawning.
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:39 user nova-compute[71206]: WARNING nova.compute.manager [req-a653ce9e-18a9-4513-92eb-cfdb094e041e req-3946c88c-de56-41fb-8eec-5d091a452fcc service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state stopped and task_state None.
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481381.3155024, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Resumed (Lifecycle Event)
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance spawned successfully.
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481381.3172832, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Started (Lifecycle Event)
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:09:41 user nova-compute[71206]: WARNING nova.compute.manager [req-aa5651fd-f057-447d-bc86-d833afc0481e req-1c9b7fae-f212-4312-a496-45a1fe575f06 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state building and task_state spawning.
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Took 6.80 seconds to spawn the instance on the hypervisor.
Jul 27 18:09:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:09:41 user nova-compute[71206]: INFO nova.compute.manager [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Took 16.57 seconds to build instance.
Jul 27 18:09:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-68376445-35a4-4766-9ef7-9a976a8f348d tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.740s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:09:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:53 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481378.712019, 7533b699-ec8e-46e4-828e-9cc82c802dce => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:09:53 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Stopped (Lifecycle Event)
Jul 27 18:09:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fdc1d53b-9ced-4543-84c0-7f0e47f6ed37 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:09:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fdc1d53b-9ced-4543-84c0-7f0e47f6ed37 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:09:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:09:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:10:00 user nova-compute[71206]: INFO nova.compute.manager [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] instance snapshotting
Jul 27 18:10:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Beginning live snapshot process
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529.delta 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529.delta 1073741824" returned: 0 in 0.095s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 18:10:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing instance network info cache due to event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'flavor' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:10:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 18:10:03 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529.delta /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:03 user nova-compute[71206]: INFO nova.compute.manager [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Attaching volume 45174623-7b49-48b9-9373-86685f4d3a4a to /dev/vdb
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.utils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a57ce-b3ad-4991-a6d5-d3b782d2422b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473f281-2834-49d0-8b57-296f0050772e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7b04f-9259-40e7-af5a-67b0565f5b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c6cf2-6d65-46e9-bc20-a99466b8f69d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:10:03 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3f627-20e6-4c5e-8098-6b553b821b25]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG os_brick.utils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating existing volume attachment record: a7034727-8ba8-4a5e-82c7-45a333e17fe8 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529.delta /opt/stack/data/nova/instances/snapshots/tmp02koy0_p/7f0fd321a7a344e89abbc993d0f99529" returned: 0 in 0.358s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Snapshot extracted, beginning image upload
Jul 27 18:10:03 user nova-compute[71206]: DEBUG nova.network.neutron [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updated VIF entry in instance network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG nova.network.neutron [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-513e74fb-ed0f-465f-aba6-106644477ac6 req-5f8117f4-c347-47b5-abde-997e644f6bbf service nova] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Snapshot image upload complete
Jul 27 18:10:06 user nova-compute[71206]: INFO nova.compute.manager [None req-6a719541-d4a4-43c5-8287-8cf42a744059 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Took 5.70 seconds to snapshot the instance on the hypervisor.
Jul 27 18:10:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUervbLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:10:10 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:10:10 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:10:10 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48116649-1b9e-4411-a7ca-ae4a85232b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:10:10 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc34a03-a5f8-4834-919f-3947bab9eda2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a] added
Jul 27 18:10:10 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96367fd5-cee4-44a0-bfc5-fa0e5959c97f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d8fbc8-6a4b-4453-a069-53e18a6ad53c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUervbLa {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUervbLa" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c438e-2f79-461a-aa81-d83e67684de2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUervbLa'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a044e35-a73b-468f-a0db-696a466cb886]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf49c92-c776-4119-b0ed-bbc98a4d889d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:10:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:10:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4b560d-d1c8-412f-86a2-3a877106fa11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260]
Jul 27 18:10:11 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260] successful.
Jul 27 18:10:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d9a887-18b9-4cb9-bbf6-4ac57fd936d2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b43ed3-9c80-47b9-b9fc-1e5dd9f6394c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:10:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:10:11 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:10:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29257653-b14a-47b8-8523-b22a17186691]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:10:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUervbLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26138363665396665', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138363665396665', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.objects.instance [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'flavor' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:10:12 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:10:12 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:10:12 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:10:12 user nova-compute[71206]:   <serial>45174623-7b49-48b9-9373-86685f4d3a4a</serial>
Jul 27 18:10:12 user nova-compute[71206]: </disk>
Jul 27 18:10:12 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:ae:15:b3, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:10:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-208325bf-4ec8-4792-83a0-820912da8bb4 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.790s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:14 user nova-compute[71206]: INFO nova.compute.manager [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Rescuing
Jul 27 18:10:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:10:15 user nova-compute[71206]: WARNING nova.compute.manager [req-f084f135-bc08-4cfe-8046-d8ec09605b29 req-5b7a5d26-9b4d-4756-9e5a-638cc3a5aa63 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state active and task_state rescuing.
Jul 27 18:10:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance destroyed successfully.
Jul 27 18:10:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Attempting rescue
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:10:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Creating image(s)
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing instance network info cache due to event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.network.neutron [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue" returned: 0 in 0.062s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'migration_context' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start _get_guest_xml network_info=[{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:ae:15:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'numa_topology' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:15 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:15 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:10:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30620632',display_name='tempest-ServerRescueNegativeTestJSON-server-30620632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30620632',id=24,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCi68c9oO92kRkhNtxabmjvRgJo4PFo88BPP1912YOJNpxv6kprwEW38bqoKHUS7lZ5RBh/UsMFWRhVeQnLE8jnJgxPhwiE+li26bPrj9IjhYuJoudkYoqP0kdcCUbBxA==',key_name='tempest-keypair-1854465445',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-4timr004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83503c246a474fb1b1591c82962b7a6c',uuid=0dabbb68-9356-4fed-934e-1aaa4ab46a4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:ae:15:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "vif_mac": "fa:16:3e:ae:15:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:10:16 user nova-compute[71206]:   <uuid>0dabbb68-9356-4fed-934e-1aaa4ab46a4f</uuid>
Jul 27 18:10:16 user nova-compute[71206]:   <name>instance-00000018</name>
Jul 27 18:10:16 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:10:16 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:10:16 user nova-compute[71206]:   <metadata>
Jul 27 18:10:16 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:10:16 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-30620632</nova:name>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:10:15</nova:creationTime>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:10:16 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:10:16 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:owner>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:user uuid="83503c246a474fb1b1591c82962b7a6c">tempest-ServerRescueNegativeTestJSON-1470187716-project-member</nova:user>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:project uuid="de3796621f174ee4850f31a657d13792">tempest-ServerRescueNegativeTestJSON-1470187716</nova:project>
Jul 27 18:10:16 user nova-compute[71206]:       </nova:owner>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:10:16 user nova-compute[71206]:       <nova:ports>
Jul 27 18:10:16 user nova-compute[71206]:         <nova:port uuid="aeeaca26-bc1b-472f-90b0-766855bf8ea2">
Jul 27 18:10:16 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:10:16 user nova-compute[71206]:         </nova:port>
Jul 27 18:10:16 user nova-compute[71206]:       </nova:ports>
Jul 27 18:10:16 user nova-compute[71206]:     </nova:instance>
Jul 27 18:10:16 user nova-compute[71206]:   </metadata>
Jul 27 18:10:16 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:10:16 user nova-compute[71206]:     <system>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="serial">0dabbb68-9356-4fed-934e-1aaa4ab46a4f</entry>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="uuid">0dabbb68-9356-4fed-934e-1aaa4ab46a4f</entry>
Jul 27 18:10:16 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:10:16 user nova-compute[71206]:     </system>
Jul 27 18:10:16 user nova-compute[71206]:   </sysinfo>
Jul 27 18:10:16 user nova-compute[71206]:   <os>
Jul 27 18:10:16 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:10:16 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:10:16 user nova-compute[71206]:   </os>
Jul 27 18:10:16 user nova-compute[71206]:   <features>
Jul 27 18:10:16 user nova-compute[71206]:     <acpi/>
Jul 27 18:10:16 user nova-compute[71206]:     <apic/>
Jul 27 18:10:16 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:10:16 user nova-compute[71206]:   </features>
Jul 27 18:10:16 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:10:16 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:10:16 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:10:16 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:10:16 user nova-compute[71206]:   </clock>
Jul 27 18:10:16 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:10:16 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:10:16 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:10:16 user nova-compute[71206]:   </cpu>
Jul 27 18:10:16 user nova-compute[71206]:   <devices>
Jul 27 18:10:16 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:10:16 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:10:16 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue"/>
Jul 27 18:10:16 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:10:16 user nova-compute[71206]:     </disk>
Jul 27 18:10:16 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:10:16 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:10:16 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk"/>
Jul 27 18:10:16 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:10:16 user nova-compute[71206]:     </disk>
Jul 27 18:10:16 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:10:16 user nova-compute[71206]:       <mac address="fa:16:3e:ae:15:b3"/>
Jul 27 18:10:16 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:10:16 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:10:16 user nova-compute[71206]:       <target dev="tapaeeaca26-bc"/>
Jul 27 18:10:16 user nova-compute[71206]:     </interface>
Jul 27 18:10:16 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:10:16 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/console.log" append="off"/>
Jul 27 18:10:16 user nova-compute[71206]:     </serial>
Jul 27 18:10:16 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:10:16 user nova-compute[71206]:     <video>
Jul 27 18:10:16 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:10:16 user nova-compute[71206]:     </video>
Jul 27 18:10:16 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:10:16 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:10:16 user nova-compute[71206]:     </rng>
Jul 27 18:10:16 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:10:16 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:10:16 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:10:16 user nova-compute[71206]:     </memballoon>
Jul 27 18:10:16 user nova-compute[71206]:   </devices>
Jul 27 18:10:16 user nova-compute[71206]: </domain>
Jul 27 18:10:16 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:10:16 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance destroyed successfully.
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] No VIF found with MAC fa:16:3e:ae:15:b3, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updated VIF entry in instance network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b713e35-cafd-4604-87ba-fc394d75e480 req-eaa7c449-3896-4760-a3eb-85dbbc26eacc service nova] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:10:17 user nova-compute[71206]: WARNING nova.compute.manager [req-f5f91eb3-e25b-4697-a085-24cf9089e2da req-4be5a8cd-3db9-48a4-af2b-3ade6b020486 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state active and task_state rescuing.
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:10:19 user nova-compute[71206]: WARNING nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state active and task_state rescuing.
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:10:19 user nova-compute[71206]: WARNING nova.compute.manager [req-e3035a3a-be77-40b3-a9e8-703880e5b567 req-e4d2032d-071f-4c38-8661-25da35aa735a service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state active and task_state rescuing.
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 0dabbb68-9356-4fed-934e-1aaa4ab46a4f due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481419.8609233, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:10:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Resumed (Lifecycle Event)
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-71d34de4-aeb3-4649-89c7-24b4269adf9b tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:10:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481419.8626962, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:10:19 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Started (Lifecycle Event)
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:10:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:10:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:26 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [{"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-f4daa5a7-ada3-4d66-a84b-ac02d78220a9" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:10:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:10:36 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:36 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=25.294105529785156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3e9e993b-fa22-4878-9829-e4be94652975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ccb00f08-4894-41f6-816f-2683b5e7315d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:10:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.860s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:10:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:10:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:10:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:51 user nova-compute[71206]: INFO nova.compute.manager [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Unshelving
Jul 27 18:10:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_requests' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'numa_topology' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:51 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:10:51 user nova-compute[71206]: INFO nova.compute.claims [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Claim successful on node user
Jul 27 18:10:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:52 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:10:52 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:10:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:52 user nova-compute[71206]: INFO nova.network.neutron [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating port 4f53b553-dbf5-4873-9894-07f719685b8d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing instance network info cache due to event network-changed-4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:10:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] Acquiring lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:10:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Creating image(s)
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] Acquired lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Refreshing network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG nova.virt.images [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] 12082a74-1453-4d02-a55e-a8929f1b5f78 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.part /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updated VIF entry in instance network info cache for port 4f53b553-dbf5-4873-9894-07f719685b8d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6eff42d0-c881-46c3-aa62-1c59adb610a9 req-463d4a3f-77b4-4cd1-99d4-1871d9333bb7 service nova] Releasing lock "refresh_cache-73e7aae9-1e07-448d-b39a-7d37920e3865" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.part /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.converted" returned: 0 in 0.470s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9,backing_fmt=raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9,backing_fmt=raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk 1073741824" returned: 0 in 0.053s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "c4c2c33523950b9bd7b106c843f498e97c1fcea9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'migration_context' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Rebasing disk image.
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 -F raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:10:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:57 user nova-compute[71206]: INFO nova.compute.manager [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Terminating instance
Jul 27 18:10:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-4a668e6f-b09b-4b4b-ae04-4f2618b376da req-a7e9099c-7b3c-4156-b0a8-1d09fcd47870 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Instance destroyed successfully.
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.objects.instance [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'resources' on Instance uuid 3e9e993b-fa22-4878-9829-e4be94652975 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1405581447',display_name='tempest-VolumesActionsTest-instance-1405581447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1405581447',id=26,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-0v1adt5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:09:14Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=3e9e993b-fa22-4878-9829-e4be94652975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "address": "fa:16:3e:52:28:4a", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb25b405-ad", "ovs_interfaceid": "bb25b405-add3-4ebf-997c-a6e991e5a3c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG os_vif [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb25b405-ad, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:58 user nova-compute[71206]: INFO os_vif [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:28:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb25b405-add3-4ebf-997c-a6e991e5a3c9,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb25b405-ad')
Jul 27 18:10:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Deleting instance files /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975_del
Jul 27 18:10:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Deletion of /opt/stack/data/nova/instances/3e9e993b-fa22-4878-9829-e4be94652975_del complete
Jul 27 18:10:58 user nova-compute[71206]: INFO nova.compute.manager [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 18:10:58 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:10:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 -F raw /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk" returned: 0 in 2.548s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Ensure instance console log exists: /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start _get_guest_xml network_info=[{"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='991e508bff3c5e55b8c06d3797188411',container_format='bare',created_at=2023-07-27T18:08:58Z,direct_url=<?>,disk_format='qcow2',id=12082a74-1453-4d02-a55e-a8929f1b5f78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-89295416-shelved',owner='3f383884701844a8b955177235bbbd4c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T18:09:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:10:59 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:59 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='991e508bff3c5e55b8c06d3797188411',container_format='bare',created_at=2023-07-27T18:08:58Z,direct_url=<?>,disk_format='qcow2',id=12082a74-1453-4d02-a55e-a8929f1b5f78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-89295416-shelved',owner='3f383884701844a8b955177235bbbd4c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T18:09:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='12082a74-1453-4d02-a55e-a8929f1b5f78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-737493504',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:09:03.645615',shelved_host='user',shelved_image_id='12082a74-1453-4d02-a55e-a8929f1b5f78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'pci_devices' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:10:59 user nova-compute[71206]:   <uuid>73e7aae9-1e07-448d-b39a-7d37920e3865</uuid>
Jul 27 18:10:59 user nova-compute[71206]:   <name>instance-00000015</name>
Jul 27 18:10:59 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:10:59 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:10:59 user nova-compute[71206]:   <metadata>
Jul 27 18:10:59 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:10:59 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-89295416</nova:name>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:10:59</nova:creationTime>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:10:59 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:10:59 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:owner>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:user uuid="4fa4ebea12dd4e89b0ae6097aae1bb7a">tempest-AttachVolumeShelveTestJSON-760609809-project-member</nova:user>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:project uuid="3f383884701844a8b955177235bbbd4c">tempest-AttachVolumeShelveTestJSON-760609809</nova:project>
Jul 27 18:10:59 user nova-compute[71206]:       </nova:owner>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:root type="image" uuid="12082a74-1453-4d02-a55e-a8929f1b5f78"/>
Jul 27 18:10:59 user nova-compute[71206]:       <nova:ports>
Jul 27 18:10:59 user nova-compute[71206]:         <nova:port uuid="4f53b553-dbf5-4873-9894-07f719685b8d">
Jul 27 18:10:59 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:10:59 user nova-compute[71206]:         </nova:port>
Jul 27 18:10:59 user nova-compute[71206]:       </nova:ports>
Jul 27 18:10:59 user nova-compute[71206]:     </nova:instance>
Jul 27 18:10:59 user nova-compute[71206]:   </metadata>
Jul 27 18:10:59 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:10:59 user nova-compute[71206]:     <system>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="serial">73e7aae9-1e07-448d-b39a-7d37920e3865</entry>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="uuid">73e7aae9-1e07-448d-b39a-7d37920e3865</entry>
Jul 27 18:10:59 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:10:59 user nova-compute[71206]:     </system>
Jul 27 18:10:59 user nova-compute[71206]:   </sysinfo>
Jul 27 18:10:59 user nova-compute[71206]:   <os>
Jul 27 18:10:59 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:10:59 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:10:59 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:10:59 user nova-compute[71206]:   </os>
Jul 27 18:10:59 user nova-compute[71206]:   <features>
Jul 27 18:10:59 user nova-compute[71206]:     <acpi/>
Jul 27 18:10:59 user nova-compute[71206]:     <apic/>
Jul 27 18:10:59 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:10:59 user nova-compute[71206]:   </features>
Jul 27 18:10:59 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:10:59 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:10:59 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:10:59 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:10:59 user nova-compute[71206]:   </clock>
Jul 27 18:10:59 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:10:59 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:10:59 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:10:59 user nova-compute[71206]:   </cpu>
Jul 27 18:10:59 user nova-compute[71206]:   <devices>
Jul 27 18:10:59 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:10:59 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:10:59 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk"/>
Jul 27 18:10:59 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:10:59 user nova-compute[71206]:     </disk>
Jul 27 18:10:59 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:10:59 user nova-compute[71206]:       <mac address="fa:16:3e:1b:9a:9c"/>
Jul 27 18:10:59 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:10:59 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:10:59 user nova-compute[71206]:       <target dev="tap4f53b553-db"/>
Jul 27 18:10:59 user nova-compute[71206]:     </interface>
Jul 27 18:10:59 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:10:59 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/console.log" append="off"/>
Jul 27 18:10:59 user nova-compute[71206]:     </serial>
Jul 27 18:10:59 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:10:59 user nova-compute[71206]:     <video>
Jul 27 18:10:59 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:10:59 user nova-compute[71206]:     </video>
Jul 27 18:10:59 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:10:59 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:10:59 user nova-compute[71206]:     </rng>
Jul 27 18:10:59 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:10:59 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:10:59 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:10:59 user nova-compute[71206]:     </memballoon>
Jul 27 18:10:59 user nova-compute[71206]:   </devices>
Jul 27 18:10:59 user nova-compute[71206]: </domain>
Jul 27 18:10:59 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='12082a74-1453-4d02-a55e-a8929f1b5f78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-737493504',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member',shelved_at='2023-07-27T18:09:03.645615',shelved_host='user',shelved_image_id='12082a74-1453-4d02-a55e-a8929f1b5f78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG os_vif [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f53b553-db, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f53b553-db, col_values=(('external_ids', {'iface-id': '4f53b553-dbf5-4873-9894-07f719685b8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:9a:9c', 'vm-uuid': '73e7aae9-1e07-448d-b39a-7d37920e3865'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: INFO os_vif [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db')
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] No VIF found with MAC fa:16:3e:1b:9a:9c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:10:59 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Took 1.37 seconds to deallocate network for instance.
Jul 27 18:10:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-4c6af9d1-9a4f-486b-8c7f-f7a43a1551bb req-12ae7097-2eff-41ed-9fe3-a4f02ce04c96 service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-deleted-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:10:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:00 user nova-compute[71206]: WARNING nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state deleted and task_state None.
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:00 user nova-compute[71206]: WARNING nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state deleted and task_state None.
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:00 user nova-compute[71206]: WARNING nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state deleted and task_state None.
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:00 user nova-compute[71206]: WARNING nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-unplugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state deleted and task_state None.
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Acquiring lock "3e9e993b-fa22-4878-9829-e4be94652975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] Lock "3e9e993b-fa22-4878-9829-e4be94652975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] No waiting events found dispatching network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:00 user nova-compute[71206]: WARNING nova.compute.manager [req-40f80d61-8b17-436e-8c97-205624eb18ae req-2125be1a-5183-4b2e-95b5-74fe06bf3d0d service nova] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Received unexpected event network-vif-plugged-bb25b405-add3-4ebf-997c-a6e991e5a3c9 for instance with vm_state deleted and task_state None.
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Deleted allocations for instance 3e9e993b-fa22-4878-9829-e4be94652975
Jul 27 18:11:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-90777653-7122-4bfb-be54-f27c3f2eea53 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "3e9e993b-fa22-4878-9829-e4be94652975" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:01 user nova-compute[71206]: WARNING nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 18:11:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:01 user nova-compute[71206]: WARNING nova.compute.manager [req-42285215-e02a-442f-9417-036d251246df req-675e37d0-a95c-481e-bac7-f261e5c087b2 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481463.1435153, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:03 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Resumed (Lifecycle Event)
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:11:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance spawned successfully.
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:03 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481463.1468167, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:03 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Started (Lifecycle Event)
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:03 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8b664952-c6fb-4103-a288-482f4e3795ba tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.743s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-changed-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Refreshing instance network info cache due to event network-changed-72e05315-8617-459d-af5a-aed58e28fcfe. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] Acquiring lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] Acquired lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Refreshing network info cache for port 72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updated VIF entry in instance network info cache for port 72e05315-8617-459d-af5a-aed58e28fcfe. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updating instance_info_cache with network_info: [{"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b20ee67a-aff9-4277-adc0-d52b3dbec78a req-e67f3330-a4a7-474e-b893-993388c4b8f9 service nova] Releasing lock "refresh_cache-ccb00f08-4894-41f6-816f-2683b5e7315d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:11:09 user nova-compute[71206]: INFO nova.compute.claims [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Claim successful on node user
Jul 27 18:11:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:11:09 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:11:09 user nova-compute[71206]: DEBUG nova.policy [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ed5535b566e42f195aebce82e14ced7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72bcdbc35df444c99f3d4045832c9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:11:09 user nova-compute[71206]: INFO nova.virt.block_device [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Booting with volume-backed-image 1bb2eba0-b0b8-44c8-a970-d8bda010fff6 at /dev/vda
Jul 27 18:11:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Successfully created port: 451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Successfully updated port: 451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-changed-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Refreshing instance network info cache due to event network-changed-451955c0-5b30-47e6-95e0-e562c3167201. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] Acquiring lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating instance_info_cache with network_info: [{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance network_info: |[{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] Acquired lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Refreshing network info cache for port 451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updated VIF entry in instance network info cache for port 451955c0-5b30-47e6-95e0-e562c3167201. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating instance_info_cache with network_info: [{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a82588c4-907f-4b30-8b00-2598876c65f4 req-d67eb7bd-b516-4999-b544-dde0fc1aca82 service nova] Releasing lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:13 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481458.2384646, 3e9e993b-fa22-4878-9829-e4be94652975 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:13 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] VM Stopped (Lifecycle Event)
Jul 27 18:11:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-c12a2182-6bb5-4ef8-9f62-23e457cd0cce None None] [instance: 3e9e993b-fa22-4878-9829-e4be94652975] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:11:14 user nova-compute[71206]: INFO nova.compute.claims [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Claim successful on node user
Jul 27 18:11:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:11:14 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:11:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:11:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:11:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:11:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:11:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:11:15 user nova-compute[71206]: INFO nova.virt.block_device [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Booting with volume snapshot 15a3f3ed-73f6-4e92-a800-3ba24cbcbc5b at /dev/vda
Jul 27 18:11:15 user nova-compute[71206]: DEBUG nova.policy [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Successfully created port: 9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-changed-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Refreshing instance network info cache due to event network-changed-ba625d39-b403-4879-890b-b86da4fbdce6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] Acquiring lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] Acquired lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Refreshing network info cache for port ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:11:17 user nova-compute[71206]: INFO nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Rebuilding instance
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'pci_requests' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'resources' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'migration_context' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updated VIF entry in instance network info cache for port ba625d39-b403-4879-890b-b86da4fbdce6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating instance_info_cache with network_info: [{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-40d7e419-c0b5-4b15-b84c-721ab59cef52 req-d02fa9f1-fcba-49bc-a9d9-02da8ff4f738 service nova] Releasing lock "refresh_cache-8f6ee1d9-26cc-483e-b880-32b74f8a75f4" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Successfully updated port: 9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-changed-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Refreshing instance network info cache due to event network-changed-9e4d5db9-0797-4180-9bf3-f26870a10b10. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:11:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] Acquiring lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:18 user nova-compute[71206]: WARNING nova.compute.manager [req-eeaf468c-a44d-42b9-913b-08f45c19ecda req-c1e6a294-b651-4510-855f-84d8715b8fa9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state active and task_state rebuilding.
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updating instance_info_cache with network_info: [{"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Instance network_info: |[{"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] Acquired lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.network.neutron [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Refreshing network info cache for port 9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:11:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance destroyed successfully.
Jul 27 18:11:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance destroyed successfully.
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1371894754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba625d39-b4, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: INFO os_vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4')
Jul 27 18:11:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:18 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a0527e-0117-4c3f-89bb-d2ade1cefaeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:11:18 user nova-compute[71206]: No targets found.
Jul 27 18:11:18 user nova-compute[71206]: iSNS:
Jul 27 18:11:18 user nova-compute[71206]: No targets found.
Jul 27 18:11:18 user nova-compute[71206]: STATIC:
Jul 27 18:11:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:11:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555
Jul 27 18:11:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:11:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:18 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:11:18 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:18 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:18 user nova-compute[71206]: FIRMWARE:
Jul 27 18:11:18 user nova-compute[71206]: No targets found.
Jul 27 18:11:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:11:18 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:11:18 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a78b96-eca4-4217-aed4-61caca4b744c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909bc2a-0d71-4c76-9643-6b8d979132d0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2c190550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c2c05-3bde-4ae7-b315-8028e9a1c614]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc2cd4-3bf9-488d-a058-d526f21670e1]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e966f0ae-666e-42dd-a29b-ac11391e7e12]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1758d69-19c5-440f-a49d-b996636835da]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23765613462326338', '/dev/disk/by-id/scsi-1SCST_BIO667bcb1f-7ea4b2c85a158049', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_667bcb1f') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[007efcad-08b5-4773-b45e-100038a45e40]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b297e21-4d4d-4dea-b133-70aa2181255a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1475c8-2904-46a3-b2e2-521eaba52fd9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]
Jul 27 18:11:18 user nova-compute[71206]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.
Jul 27 18:11:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[267fbcd3-504b-43c7-ab36-d4c5093b26ad]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== disconnect_volume: return (413ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:11:19 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deleting instance files /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4_del
Jul 27 18:11:19 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deletion of /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4_del complete
Jul 27 18:11:19 user nova-compute[71206]: DEBUG nova.network.neutron [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updated VIF entry in instance network info cache for port 9e4d5db9-0797-4180-9bf3-f26870a10b10. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG nova.network.neutron [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updating instance_info_cache with network_info: [{"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f3165cb8-09f6-44e9-8d3b-3294f2f5216f req-54080ea7-eb29-46cd-95ca-aaf4a3a66d1a service nova] Releasing lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:19 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 could not be found.
Jul 27 18:11:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:19 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93801091-e689-4bcc-8c0a-b4055d92490c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:11:19 user nova-compute[71206]: No targets found.
Jul 27 18:11:19 user nova-compute[71206]: iSNS:
Jul 27 18:11:19 user nova-compute[71206]: No targets found.
Jul 27 18:11:19 user nova-compute[71206]: STATIC:
Jul 27 18:11:19 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:11:19 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:19 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:19 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:11:19 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:19 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:19 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:11:19 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:11:19 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:11:19 user nova-compute[71206]: FIRMWARE:
Jul 27 18:11:19 user nova-compute[71206]: No targets found.
Jul 27 18:11:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:11:19 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:11:19 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae511f4-3384-44ee-9cd5-5f554523cd57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ab88f-a4ea-41b8-821c-b2abfe6acc2f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e329365f0>, {}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Disconnecting from: [] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== disconnect_volume: return (78ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:20 user nova-compute[71206]: WARNING nova.compute.manager [req-2a440563-db3b-4266-81db-1b9bc45a8e8b req-9fa720c3-7062-41f5-9cc4-99d37865e21e service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state active and task_state rebuilding.
Jul 27 18:11:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Preparing to wait for external event volume-reimaged-c431fc05-bf9b-4ffd-853e-2bc6c260b555 {{(pid=71206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.utils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d76894-fe22-49b1-88d5-3362b9fb26d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0c16e-1476-4992-9cfd-f1d7e66821ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[960510bb-0500-4f32-9663-8f3668ce6943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c3f50-0ab7-4360-8ab4-fd6cbeeb3fa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:20 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:11:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[614822d4-ec37-4445-8839-e66e479987fd]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG os_brick.utils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating existing volume attachment record: d832e8bb-e032-4c52-97f9-5970635ace5c {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:11:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.utils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c82289-d0e1-4fa3-9706-66d81bf9fa0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f9cfaa-6727-466d-8066-e9aa6f3e5c39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9597a4f-909c-4211-af80-a34191630db3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2112f36-a1b3-46a5-b841-7861dbfc2365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:21 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:11:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6077e5-f5d0-4649-a9ef-4f35f1652387]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG os_brick.utils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:21 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updating existing volume attachment record: db7a1362-cfd8-4d0a-9572-12174927dd8c {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:11:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:11:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'info_cache' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance destroyed successfully.
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'resources' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG os_vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e52ab25-92, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:28 user nova-compute[71206]: INFO os_vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start _get_guest_xml network_info=[{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'numa_topology' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:28 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'pci_devices' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:11:28 user nova-compute[71206]:   <uuid>7533b699-ec8e-46e4-828e-9cc82c802dce</uuid>
Jul 27 18:11:28 user nova-compute[71206]:   <name>instance-00000011</name>
Jul 27 18:11:28 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:11:28 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:11:28 user nova-compute[71206]:   <metadata>
Jul 27 18:11:28 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:11:28 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1846081917</nova:name>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:11:28</nova:creationTime>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:11:28 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:11:28 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:owner>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:user uuid="faa59a3fcaa042999a5f0c357a5ef42c">tempest-AttachVolumeTestJSON-497623291-project-member</nova:user>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:project uuid="7cd626aa35a645b5b9ce1f5bf9652c79">tempest-AttachVolumeTestJSON-497623291</nova:project>
Jul 27 18:11:28 user nova-compute[71206]:       </nova:owner>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:11:28 user nova-compute[71206]:       <nova:ports>
Jul 27 18:11:28 user nova-compute[71206]:         <nova:port uuid="7e52ab25-92dd-4d48-9037-a402f9f3c98b">
Jul 27 18:11:28 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 18:11:28 user nova-compute[71206]:         </nova:port>
Jul 27 18:11:28 user nova-compute[71206]:       </nova:ports>
Jul 27 18:11:28 user nova-compute[71206]:     </nova:instance>
Jul 27 18:11:28 user nova-compute[71206]:   </metadata>
Jul 27 18:11:28 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:11:28 user nova-compute[71206]:     <system>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="serial">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="uuid">7533b699-ec8e-46e4-828e-9cc82c802dce</entry>
Jul 27 18:11:28 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:11:28 user nova-compute[71206]:     </system>
Jul 27 18:11:28 user nova-compute[71206]:   </sysinfo>
Jul 27 18:11:28 user nova-compute[71206]:   <os>
Jul 27 18:11:28 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:11:28 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:11:28 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:11:28 user nova-compute[71206]:   </os>
Jul 27 18:11:28 user nova-compute[71206]:   <features>
Jul 27 18:11:28 user nova-compute[71206]:     <acpi/>
Jul 27 18:11:28 user nova-compute[71206]:     <apic/>
Jul 27 18:11:28 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:11:28 user nova-compute[71206]:   </features>
Jul 27 18:11:28 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:11:28 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:11:28 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:11:28 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:11:28 user nova-compute[71206]:   </clock>
Jul 27 18:11:28 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:11:28 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:11:28 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:11:28 user nova-compute[71206]:   </cpu>
Jul 27 18:11:28 user nova-compute[71206]:   <devices>
Jul 27 18:11:28 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:11:28 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:11:28 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk"/>
Jul 27 18:11:28 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:11:28 user nova-compute[71206]:     </disk>
Jul 27 18:11:28 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:11:28 user nova-compute[71206]:       <mac address="fa:16:3e:97:c1:c7"/>
Jul 27 18:11:28 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:28 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:11:28 user nova-compute[71206]:       <target dev="tap7e52ab25-92"/>
Jul 27 18:11:28 user nova-compute[71206]:     </interface>
Jul 27 18:11:28 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:11:28 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/console.log" append="off"/>
Jul 27 18:11:28 user nova-compute[71206]:     </serial>
Jul 27 18:11:28 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:11:28 user nova-compute[71206]:     <video>
Jul 27 18:11:28 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:28 user nova-compute[71206]:     </video>
Jul 27 18:11:28 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:11:28 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:11:28 user nova-compute[71206]:     </rng>
Jul 27 18:11:28 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:11:28 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:11:28 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:11:28 user nova-compute[71206]:     </memballoon>
Jul 27 18:11:28 user nova-compute[71206]:   </devices>
Jul 27 18:11:28 user nova-compute[71206]: </domain>
Jul 27 18:11:28 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Cannot resize image /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'migration_context' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG os_vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e52ab25-92, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e52ab25-92, col_values=(('external_ids', {'iface-id': '7e52ab25-92dd-4d48-9037-a402f9f3c98b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c1:c7', 'vm-uuid': '7533b699-ec8e-46e4-828e-9cc82c802dce'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:29 user nova-compute[71206]: INFO os_vif [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:11:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Creating image(s)
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Ensure instance console log exists: /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start _get_guest_xml network_info=[{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'd832e8bb-e032-4c52-97f9-5970635ace5c', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31095d6b-990e-4fc5-ad0b-1cfed57cc0e6', 'attached_at': '', 'detached_at': '', 'volume_id': '0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'serial': '0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:11:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:29 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:11:29 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:30 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8445e8a7-6863-4110-80f6-20a91d00a1a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:11:30 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[024bc713-26e5-45dd-bba6-fbe2117eb15e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c] added
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05fd160-9d4d-49e8-8206-6320cdb60b11]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c681da7c-4c49-4c63-a14e-d49807e7c2d5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwkipKUn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwkipKUn" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c93f826-d588-426e-a908-c7dcd060be02]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwkipKUn'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170fb19-5f70-40e4-b4e8-39b89c70af84]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617ee33-ed3e-4459-9550-235953842d02]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:11:30 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Creating image(s)
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Ensure instance console log exists: /opt/stack/data/nova/instances/62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Start _get_guest_xml network_info=[{"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T18:11:06Z,direct_url=<?>,disk_format='qcow2',id=9ba1f260-6b54-4071-aba7-ae6c666fc426,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1101762405',owner='9ea22847821f4d6d9a2a6b127ee5ce6b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T18:11:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': 'db7a1362-cfd8-4d0a-9572-12174927dd8c', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCLdYfGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8', 'attached_at': '', 'detached_at': '', 'volume_id': '5b211789-d438-4247-bad7-5954a702825e', 'serial': '5b211789-d438-4247-bad7-5954a702825e'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:11:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T18:11:06Z,direct_url=<?>,disk_format='qcow2',id=9ba1f260-6b54-4071-aba7-ae6c666fc426,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1101762405',owner='9ea22847821f4d6d9a2a6b127ee5ce6b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T18:11:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCLdYfGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:30 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4298e-3e7a-4c5f-8867-5529d4fdc93a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260]
Jul 27 18:11:30 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260] successful.
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9ca06-bae6-4334-8138-be86e41bb6b1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae8c2f-3af4-4372-85e3-b64c798f4ea7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:30 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e75c0f2-ceeb-46f3-a0e2-7c0f560b6521]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:11:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26365333133303038', 'path': '/dev/sdf'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365333133303038', 'path': '/dev/sdf'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.093s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:31 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:31 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19a5cfa-c6b3-441a-90a3-e8232459d1b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:11:31 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-244505156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-244505156',id=29,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-fx5qtyqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:10Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=31095d6b-990e-4fc5-ad0b-1cfed57cc0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad491ccc-3b7f-4707-a7e2-07d2a5b166dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e] added
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[055cc7dd-71cc-4b84-acbf-9482a195cd6f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:31 user nova-compute[71206]: WARNING nova.compute.manager [req-5947ae87-5e46-4236-966e-9910e8a653a7 req-6f61c8d3-9b26-4cff-ba17-7b36447337a4 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state stopped and task_state powering-on.
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:11:31 user nova-compute[71206]:   <uuid>31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</uuid>
Jul 27 18:11:31 user nova-compute[71206]:   <name>instance-0000001d</name>
Jul 27 18:11:31 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:11:31 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:11:31 user nova-compute[71206]:   <metadata>
Jul 27 18:11:31 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:11:31 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-244505156</nova:name>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:11:29</nova:creationTime>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:11:31 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:11:31 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:owner>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 18:11:31 user nova-compute[71206]:       </nova:owner>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:11:31 user nova-compute[71206]:       <nova:ports>
Jul 27 18:11:31 user nova-compute[71206]:         <nova:port uuid="451955c0-5b30-47e6-95e0-e562c3167201">
Jul 27 18:11:31 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:11:31 user nova-compute[71206]:         </nova:port>
Jul 27 18:11:31 user nova-compute[71206]:       </nova:ports>
Jul 27 18:11:31 user nova-compute[71206]:     </nova:instance>
Jul 27 18:11:31 user nova-compute[71206]:   </metadata>
Jul 27 18:11:31 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:11:31 user nova-compute[71206]:     <system>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="serial">31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</entry>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="uuid">31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</entry>
Jul 27 18:11:31 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:11:31 user nova-compute[71206]:     </system>
Jul 27 18:11:31 user nova-compute[71206]:   </sysinfo>
Jul 27 18:11:31 user nova-compute[71206]:   <os>
Jul 27 18:11:31 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:11:31 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:11:31 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:11:31 user nova-compute[71206]:   </os>
Jul 27 18:11:31 user nova-compute[71206]:   <features>
Jul 27 18:11:31 user nova-compute[71206]:     <acpi/>
Jul 27 18:11:31 user nova-compute[71206]:     <apic/>
Jul 27 18:11:31 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:11:31 user nova-compute[71206]:   </features>
Jul 27 18:11:31 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:11:31 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:11:31 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:11:31 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:11:31 user nova-compute[71206]:   </clock>
Jul 27 18:11:31 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:11:31 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:11:31 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:11:31 user nova-compute[71206]:   </cpu>
Jul 27 18:11:31 user nova-compute[71206]:   <devices>
Jul 27 18:11:31 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:11:31 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:11:31 user nova-compute[71206]:       <source dev="/dev/sdf"/>
Jul 27 18:11:31 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:11:31 user nova-compute[71206]:       <serial>0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c</serial>
Jul 27 18:11:31 user nova-compute[71206]:     </disk>
Jul 27 18:11:31 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:11:31 user nova-compute[71206]:       <mac address="fa:16:3e:dd:50:84"/>
Jul 27 18:11:31 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:31 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:11:31 user nova-compute[71206]:       <target dev="tap451955c0-5b"/>
Jul 27 18:11:31 user nova-compute[71206]:     </interface>
Jul 27 18:11:31 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:11:31 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/console.log" append="off"/>
Jul 27 18:11:31 user nova-compute[71206]:     </serial>
Jul 27 18:11:31 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:11:31 user nova-compute[71206]:     <video>
Jul 27 18:11:31 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:31 user nova-compute[71206]:     </video>
Jul 27 18:11:31 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:11:31 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:11:31 user nova-compute[71206]:     </rng>
Jul 27 18:11:31 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:11:31 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:11:31 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:11:31 user nova-compute[71206]:     </memballoon>
Jul 27 18:11:31 user nova-compute[71206]:   </devices>
Jul 27 18:11:31 user nova-compute[71206]: </domain>
Jul 27 18:11:31 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-244505156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-244505156',id=29,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-fx5qtyqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:10Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=31095d6b-990e-4fc5-ad0b-1cfed57cc0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_vif [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[593c9456-84c1-4cf9-b8fc-432c4e8ec0fb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCLdYfGS {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451955c0-5b, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap451955c0-5b, col_values=(('external_ids', {'iface-id': '451955c0-5b30-47e6-95e0-e562c3167201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:50:84', 'vm-uuid': '31095d6b-990e-4fc5-ad0b-1cfed57cc0e6'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCLdYfGS" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0812b994-8a5a-4bd4-a7d4-e4379ef23a2b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MCLdYfGS'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: INFO os_vif [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b')
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff8acaa-ae7e-4435-a37e-176b6358b43b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:dd:50:84, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b637e-3c31-4025-be44-6fb3a2ab02c3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd96871b-ffe4-4a59-8822-917e51dc13d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260]
Jul 27 18:11:31 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260] successful.
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3ad18-a57b-47c5-9461-de3ceabd7b45]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[639375a9-a61f-487e-899b-65699156cdd9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd29da-b107-4968-af6f-09724d5c3333]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:11:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCLdYfGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (2498ms) {'type': 'block', 'scsi_wwn': '26331623566653638', 'path': '/dev/sdg'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331623566653638', 'path': '/dev/sdg'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867884095',id=30,image_ref='9ba1f260-6b54-4071-aba7-ae6c666fc426',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCERwwmBduBNgWLbmiDtyH0z8niYqqRr1O+5/EJqNyiwMap9232rzgJ9+31pnOCXu4G1yu4SFQaNOMqTyMuJYadiAIsTaYRNC8XqnyrmPuhz35QNOk34eeX6y22BRbULZg==',key_name='tempest-keypair-677742062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-lg7fxd88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1571765582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:11:32 user nova-compute[71206]:   <uuid>62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8</uuid>
Jul 27 18:11:32 user nova-compute[71206]:   <name>instance-0000001e</name>
Jul 27 18:11:32 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:11:32 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:11:32 user nova-compute[71206]:   <metadata>
Jul 27 18:11:32 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:11:32 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1867884095</nova:name>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:11:30</nova:creationTime>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:11:32 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:11:32 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:owner>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:11:32 user nova-compute[71206]:       </nova:owner>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:root type="image" uuid="9ba1f260-6b54-4071-aba7-ae6c666fc426"/>
Jul 27 18:11:32 user nova-compute[71206]:       <nova:ports>
Jul 27 18:11:32 user nova-compute[71206]:         <nova:port uuid="9e4d5db9-0797-4180-9bf3-f26870a10b10">
Jul 27 18:11:32 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 18:11:32 user nova-compute[71206]:         </nova:port>
Jul 27 18:11:32 user nova-compute[71206]:       </nova:ports>
Jul 27 18:11:32 user nova-compute[71206]:     </nova:instance>
Jul 27 18:11:32 user nova-compute[71206]:   </metadata>
Jul 27 18:11:32 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:11:32 user nova-compute[71206]:     <system>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="serial">62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8</entry>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="uuid">62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8</entry>
Jul 27 18:11:32 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:11:32 user nova-compute[71206]:     </system>
Jul 27 18:11:32 user nova-compute[71206]:   </sysinfo>
Jul 27 18:11:32 user nova-compute[71206]:   <os>
Jul 27 18:11:32 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:11:32 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:11:32 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:11:32 user nova-compute[71206]:   </os>
Jul 27 18:11:32 user nova-compute[71206]:   <features>
Jul 27 18:11:32 user nova-compute[71206]:     <acpi/>
Jul 27 18:11:32 user nova-compute[71206]:     <apic/>
Jul 27 18:11:32 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:11:32 user nova-compute[71206]:   </features>
Jul 27 18:11:32 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:11:32 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:11:32 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:11:32 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:11:32 user nova-compute[71206]:   </clock>
Jul 27 18:11:32 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:11:32 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:11:32 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:11:32 user nova-compute[71206]:   </cpu>
Jul 27 18:11:32 user nova-compute[71206]:   <devices>
Jul 27 18:11:32 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:11:32 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:11:32 user nova-compute[71206]:       <source dev="/dev/sdg"/>
Jul 27 18:11:32 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:11:32 user nova-compute[71206]:       <serial>5b211789-d438-4247-bad7-5954a702825e</serial>
Jul 27 18:11:32 user nova-compute[71206]:     </disk>
Jul 27 18:11:32 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:11:32 user nova-compute[71206]:       <mac address="fa:16:3e:45:d5:b5"/>
Jul 27 18:11:32 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:32 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:11:32 user nova-compute[71206]:       <target dev="tap9e4d5db9-07"/>
Jul 27 18:11:32 user nova-compute[71206]:     </interface>
Jul 27 18:11:32 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:11:32 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8/console.log" append="off"/>
Jul 27 18:11:32 user nova-compute[71206]:     </serial>
Jul 27 18:11:32 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:11:32 user nova-compute[71206]:     <video>
Jul 27 18:11:32 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:32 user nova-compute[71206]:     </video>
Jul 27 18:11:32 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:11:32 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:11:32 user nova-compute[71206]:     </rng>
Jul 27 18:11:32 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:11:32 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:11:32 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:11:32 user nova-compute[71206]:     </memballoon>
Jul 27 18:11:32 user nova-compute[71206]:   </devices>
Jul 27 18:11:32 user nova-compute[71206]: </domain>
Jul 27 18:11:32 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867884095',id=30,image_ref='9ba1f260-6b54-4071-aba7-ae6c666fc426',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCERwwmBduBNgWLbmiDtyH0z8niYqqRr1O+5/EJqNyiwMap9232rzgJ9+31pnOCXu4G1yu4SFQaNOMqTyMuJYadiAIsTaYRNC8XqnyrmPuhz35QNOk34eeX6y22BRbULZg==',key_name='tempest-keypair-677742062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-lg7fxd88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1571765582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG os_vif [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e4d5db9-07, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e4d5db9-07, col_values=(('external_ids', {'iface-id': '9e4d5db9-0797-4180-9bf3-f26870a10b10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:d5:b5', 'vm-uuid': '62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:32 user nova-compute[71206]: INFO os_vif [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07')
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:11:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:45:d5:b5, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481493.4586313, 7533b699-ec8e-46e4-828e-9cc82c802dce => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Resumed (Lifecycle Event)
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance rebooted successfully.
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ea5de3ff-9bef-484f-a7a2-f65c8944627b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481493.4587817, 7533b699-ec8e-46e4-828e-9cc82c802dce => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:33 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Started (Lifecycle Event)
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481478.53237, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:33 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Stopped (Lifecycle Event)
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:33 user nova-compute[71206]: WARNING nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state stopped and task_state powering-on.
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:33 user nova-compute[71206]: WARNING nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state building and task_state spawning.
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:33 user nova-compute[71206]: WARNING nova.compute.manager [req-87d98913-608b-418d-9ce2-e79a2566d8bc req-6bc17427-c538-4166-a9e3-1428e929066a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state building and task_state spawning.
Jul 27 18:11:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ca7d49cd-64b9-4c4a-9099-06c61c807297 None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] No waiting events found dispatching network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:34 user nova-compute[71206]: WARNING nova.compute.manager [req-4aec913f-00c8-4d08-ba9b-277db28798d2 req-919612b1-e46b-4c16-85f2-5a125cb8b1c2 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received unexpected event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 for instance with vm_state building and task_state spawning.
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481496.5692573, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Resumed (Lifecycle Event)
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance spawned successfully.
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481496.5777814, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Started (Lifecycle Event)
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Took 6.95 seconds to spawn the instance on the hypervisor.
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:36 user nova-compute[71206]: INFO nova.compute.manager [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Took 27.79 seconds to build instance.
Jul 27 18:11:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2b25ed2-bc13-4c8b-8f7c-f9a1b78e159b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.922s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] No waiting events found dispatching network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:37 user nova-compute[71206]: WARNING nova.compute.manager [req-6af4f982-d5a8-483d-8bc1-af30ca6b3c59 req-2d174d95-8926-4e4c-ab50-883b0d07de94 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received unexpected event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 for instance with vm_state building and task_state spawning.
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481497.2075305, 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] VM Resumed (Lifecycle Event)
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Instance spawned successfully.
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481497.208322, 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] VM Started (Lifecycle Event)
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Took 7.22 seconds to spawn the instance on the hypervisor.
Jul 27 18:11:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:37 user nova-compute[71206]: INFO nova.compute.manager [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Took 23.22 seconds to build instance.
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e38f238d-4436-4a00-987b-d03563944e7f tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.384s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-7a3f9b35-177a-4b14-af16-15a6527b891c req-cb3d64cd-dd09-4dbf-996b-bbff82543dfb service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event volume-reimaged-c431fc05-bf9b-4ffd-853e-2bc6c260b555 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a3f9b35-177a-4b14-af16-15a6527b891c req-cb3d64cd-dd09-4dbf-996b-bbff82543dfb service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a3f9b35-177a-4b14-af16-15a6527b891c req-cb3d64cd-dd09-4dbf-996b-bbff82543dfb service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7a3f9b35-177a-4b14-af16-15a6527b891c req-cb3d64cd-dd09-4dbf-996b-bbff82543dfb service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-7a3f9b35-177a-4b14-af16-15a6527b891c req-cb3d64cd-dd09-4dbf-996b-bbff82543dfb service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Processing event volume-reimaged-c431fc05-bf9b-4ffd-853e-2bc6c260b555 {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:38 user nova-compute[71206]: INFO nova.virt.block_device [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Booting with volume c431fc05-bf9b-4ffd-853e-2bc6c260b555 at /dev/vda
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.utils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77726c5-5eaf-450e-bb94-f6c0cb580af5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e789c8-30be-4ca9-9385-18bec47c083f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c901a17-a055-4ab8-869b-01ee56c966d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44e5eef-a784-43ea-8888-50a305aa3f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:11:38 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a2dda-8cf2-47d9-94ec-7d4012dc8769]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG os_brick.utils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating existing volume attachment record: 6e0e0e5c-0e64-419b-a55b-4395f05d2d4d {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:11:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:11:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:41 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7393MB free_disk=25.2623291015625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ccb00f08-4894-41f6-816f-2683b5e7315d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 73e7aae9-1e07-448d-b39a-7d37920e3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:11:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:11:42 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:11:42 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:11:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:11:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:11:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Creating image(s)
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Ensure instance console log exists: /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start _get_guest_xml network_info=[{"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '6e0e0e5c-0e64-419b-a55b-4395f05d2d4d', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f6ee1d9-26cc-483e-b880-32b74f8a75f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'serial': 'c431fc05-bf9b-4ffd-853e-2bc6c260b555'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:11:47 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 18:11:47 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:11:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:11:47 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98a61c-95e9-4bab-9c30-a351c5837198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:11:47 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[890a2ac4-9828-4bc5-8c8b-f2835ecbf889]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555] added
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f42809-f619-4bf9-9fb1-c6d370fd7a57]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[256af16d-7295-4cc3-81a2-947f232346f1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlNIidrp {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlNIidrp" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a8a7c7-4e90-47e7-992f-21d1ce3c9836]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vlNIidrp'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684b777-75a8-4d49-94c8-1ab976fc5219]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e92241a-ef47-4f38-9d2c-f6e1f81e0df1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ade01e-0b41-47d5-9eb4-c7d670add341]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]
Jul 27 18:11:47 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[76828331-24ca-4fb2-aa25-571cc707c734]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdea25c-2f38-417f-8337-55307de646e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:11:47 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:11:47 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e219e90d-f2c3-47e0-8776-f458ed3b9ad1]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:11:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23765613462326338', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613462326338', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1371894754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:11:48 user nova-compute[71206]:   <uuid>8f6ee1d9-26cc-483e-b880-32b74f8a75f4</uuid>
Jul 27 18:11:48 user nova-compute[71206]:   <name>instance-0000001c</name>
Jul 27 18:11:48 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:11:48 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:11:48 user nova-compute[71206]:   <metadata>
Jul 27 18:11:48 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:11:48 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:11:48 user nova-compute[71206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1371894754</nova:name>
Jul 27 18:11:48 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:11:47</nova:creationTime>
Jul 27 18:11:48 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:11:48 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:11:48 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:11:48 user nova-compute[71206]:       <nova:owner>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:user uuid="eabbb175332e41a8b21867f294e13803">tempest-ServerActionsV293TestJSON-806702460-project-member</nova:user>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:project uuid="74bcbc7c97e64b3cbfa2b488963e7ed4">tempest-ServerActionsV293TestJSON-806702460</nova:project>
Jul 27 18:11:48 user nova-compute[71206]:       </nova:owner>
Jul 27 18:11:48 user nova-compute[71206]:       <nova:ports>
Jul 27 18:11:48 user nova-compute[71206]:         <nova:port uuid="ba625d39-b403-4879-890b-b86da4fbdce6">
Jul 27 18:11:48 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 18:11:48 user nova-compute[71206]:         </nova:port>
Jul 27 18:11:48 user nova-compute[71206]:       </nova:ports>
Jul 27 18:11:48 user nova-compute[71206]:     </nova:instance>
Jul 27 18:11:48 user nova-compute[71206]:   </metadata>
Jul 27 18:11:48 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:11:48 user nova-compute[71206]:     <system>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="serial">8f6ee1d9-26cc-483e-b880-32b74f8a75f4</entry>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="uuid">8f6ee1d9-26cc-483e-b880-32b74f8a75f4</entry>
Jul 27 18:11:48 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:11:48 user nova-compute[71206]:     </system>
Jul 27 18:11:48 user nova-compute[71206]:   </sysinfo>
Jul 27 18:11:48 user nova-compute[71206]:   <os>
Jul 27 18:11:48 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:11:48 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:11:48 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:11:48 user nova-compute[71206]:   </os>
Jul 27 18:11:48 user nova-compute[71206]:   <features>
Jul 27 18:11:48 user nova-compute[71206]:     <acpi/>
Jul 27 18:11:48 user nova-compute[71206]:     <apic/>
Jul 27 18:11:48 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:11:48 user nova-compute[71206]:   </features>
Jul 27 18:11:48 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:11:48 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:11:48 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:11:48 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:11:48 user nova-compute[71206]:   </clock>
Jul 27 18:11:48 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:11:48 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:11:48 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:11:48 user nova-compute[71206]:   </cpu>
Jul 27 18:11:48 user nova-compute[71206]:   <devices>
Jul 27 18:11:48 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:11:48 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:11:48 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:11:48 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:11:48 user nova-compute[71206]:       <serial>c431fc05-bf9b-4ffd-853e-2bc6c260b555</serial>
Jul 27 18:11:48 user nova-compute[71206]:     </disk>
Jul 27 18:11:48 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:11:48 user nova-compute[71206]:       <mac address="fa:16:3e:9b:ff:a3"/>
Jul 27 18:11:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:48 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:11:48 user nova-compute[71206]:       <target dev="tapba625d39-b4"/>
Jul 27 18:11:48 user nova-compute[71206]:     </interface>
Jul 27 18:11:48 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:11:48 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4/console.log" append="off"/>
Jul 27 18:11:48 user nova-compute[71206]:     </serial>
Jul 27 18:11:48 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:11:48 user nova-compute[71206]:     <video>
Jul 27 18:11:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:48 user nova-compute[71206]:     </video>
Jul 27 18:11:48 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:11:48 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:11:48 user nova-compute[71206]:     </rng>
Jul 27 18:11:48 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:11:48 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:11:48 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:11:48 user nova-compute[71206]:     </memballoon>
Jul 27 18:11:48 user nova-compute[71206]:   </devices>
Jul 27 18:11:48 user nova-compute[71206]: </domain>
Jul 27 18:11:48 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1371894754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG os_vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba625d39-b4, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba625d39-b4, col_values=(('external_ids', {'iface-id': 'ba625d39-b403-4879-890b-b86da4fbdce6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:ff:a3', 'vm-uuid': '8f6ee1d9-26cc-483e-b880-32b74f8a75f4'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:48 user nova-compute[71206]: INFO os_vif [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4')
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] No VIF found with MAC fa:16:3e:9b:ff:a3, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:11:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:11:49 user nova-compute[71206]: INFO nova.compute.claims [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Claim successful on node user
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:11:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:11:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.policy [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dce6f9174404f8ea1acfc078ffbaca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7618aaed15347c7ad497b5676c136eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:11:50 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Creating image(s)
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "/opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "/opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:50 user nova-compute[71206]: WARNING nova.compute.manager [req-53c74466-6cfe-458d-ab0c-8a79fbc0bc7c req-ac4658a2-15a0-4410-9e6e-c4903021f69b service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.174s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk 1073741824" returned: 0 in 0.077s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.164s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Cannot resize image /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'migration_context' on Instance uuid e8157272-448d-4844-94ed-ee577be9a5dd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Ensure instance console log exists: /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Successfully created port: 080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Successfully updated port: 080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquired lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-changed-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Refreshing instance network info cache due to event network-changed-080e628e-49bc-4556-8b80-2d5e3d928eeb. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] Acquiring lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:11:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Updating instance_info_cache with network_info: [{"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Releasing lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Instance network_info: |[{"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] Acquired lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Refreshing network info cache for port 080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Start _get_guest_xml network_info=[{"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:11:52 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:52 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481512.2389452, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Resumed (Lifecycle Event)
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1103268985',display_name='tempest-VolumesActionsTest-instance-1103268985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1103268985',id=31,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-ueyl23w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:50Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=e8157272-448d-4844-94ed-ee577be9a5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'pci_devices' on Instance uuid e8157272-448d-4844-94ed-ee577be9a5dd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance spawned successfully.
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:11:52 user nova-compute[71206]:   <uuid>e8157272-448d-4844-94ed-ee577be9a5dd</uuid>
Jul 27 18:11:52 user nova-compute[71206]:   <name>instance-0000001f</name>
Jul 27 18:11:52 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:11:52 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:11:52 user nova-compute[71206]:   <metadata>
Jul 27 18:11:52 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:11:52 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:name>tempest-VolumesActionsTest-instance-1103268985</nova:name>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:11:52</nova:creationTime>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:11:52 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:11:52 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:owner>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:user uuid="5dce6f9174404f8ea1acfc078ffbaca9">tempest-VolumesActionsTest-754244769-project-member</nova:user>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:project uuid="b7618aaed15347c7ad497b5676c136eb">tempest-VolumesActionsTest-754244769</nova:project>
Jul 27 18:11:52 user nova-compute[71206]:       </nova:owner>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:11:52 user nova-compute[71206]:       <nova:ports>
Jul 27 18:11:52 user nova-compute[71206]:         <nova:port uuid="080e628e-49bc-4556-8b80-2d5e3d928eeb">
Jul 27 18:11:52 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:11:52 user nova-compute[71206]:         </nova:port>
Jul 27 18:11:52 user nova-compute[71206]:       </nova:ports>
Jul 27 18:11:52 user nova-compute[71206]:     </nova:instance>
Jul 27 18:11:52 user nova-compute[71206]:   </metadata>
Jul 27 18:11:52 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:11:52 user nova-compute[71206]:     <system>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="serial">e8157272-448d-4844-94ed-ee577be9a5dd</entry>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="uuid">e8157272-448d-4844-94ed-ee577be9a5dd</entry>
Jul 27 18:11:52 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:11:52 user nova-compute[71206]:     </system>
Jul 27 18:11:52 user nova-compute[71206]:   </sysinfo>
Jul 27 18:11:52 user nova-compute[71206]:   <os>
Jul 27 18:11:52 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:11:52 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:11:52 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:11:52 user nova-compute[71206]:   </os>
Jul 27 18:11:52 user nova-compute[71206]:   <features>
Jul 27 18:11:52 user nova-compute[71206]:     <acpi/>
Jul 27 18:11:52 user nova-compute[71206]:     <apic/>
Jul 27 18:11:52 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:11:52 user nova-compute[71206]:   </features>
Jul 27 18:11:52 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:11:52 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:11:52 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:11:52 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:11:52 user nova-compute[71206]:   </clock>
Jul 27 18:11:52 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:11:52 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:11:52 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:11:52 user nova-compute[71206]:   </cpu>
Jul 27 18:11:52 user nova-compute[71206]:   <devices>
Jul 27 18:11:52 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:11:52 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:11:52 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk"/>
Jul 27 18:11:52 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:11:52 user nova-compute[71206]:     </disk>
Jul 27 18:11:52 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:11:52 user nova-compute[71206]:       <mac address="fa:16:3e:1f:3e:12"/>
Jul 27 18:11:52 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:52 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:11:52 user nova-compute[71206]:       <target dev="tap080e628e-49"/>
Jul 27 18:11:52 user nova-compute[71206]:     </interface>
Jul 27 18:11:52 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:11:52 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/console.log" append="off"/>
Jul 27 18:11:52 user nova-compute[71206]:     </serial>
Jul 27 18:11:52 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:11:52 user nova-compute[71206]:     <video>
Jul 27 18:11:52 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:11:52 user nova-compute[71206]:     </video>
Jul 27 18:11:52 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:11:52 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:11:52 user nova-compute[71206]:     </rng>
Jul 27 18:11:52 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:11:52 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:11:52 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:11:52 user nova-compute[71206]:     </memballoon>
Jul 27 18:11:52 user nova-compute[71206]:   </devices>
Jul 27 18:11:52 user nova-compute[71206]: </domain>
Jul 27 18:11:52 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1103268985',display_name='tempest-VolumesActionsTest-instance-1103268985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1103268985',id=31,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-ueyl23w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:50Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=e8157272-448d-4844-94ed-ee577be9a5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG os_vif [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap080e628e-49, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap080e628e-49, col_values=(('external_ids', {'iface-id': '080e628e-49bc-4556-8b80-2d5e3d928eeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:3e:12', 'vm-uuid': 'e8157272-448d-4844-94ed-ee577be9a5dd'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481512.240347, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Started (Lifecycle Event)
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:52 user nova-compute[71206]: WARNING nova.compute.manager [req-3680c8c9-9390-4632-9694-2bcb97d698f1 req-41cdb4cb-3048-4ac1-b42f-5085e7292d7d service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 18:11:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:52 user nova-compute[71206]: INFO os_vif [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49')
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:52 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] No VIF found with MAC fa:16:3e:1f:3e:12, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7a3f9b35-177a-4b14-af16-15a6527b891c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.181s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Updated VIF entry in instance network info cache for port 080e628e-49bc-4556-8b80-2d5e3d928eeb. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Updating instance_info_cache with network_info: [{"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:11:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0df73101-cc2b-44eb-b5cc-84c348cd223a req-cb1e90e2-a747-412e-84ed-b5febbe22529 service nova] Releasing lock "refresh_cache-e8157272-448d-4844-94ed-ee577be9a5dd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:11:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] No waiting events found dispatching network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:54 user nova-compute[71206]: WARNING nova.compute.manager [req-afe99f32-a56d-44ea-8d95-59bfe2021265 req-eb7a0b36-0319-4673-b5dc-4647d469a150 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received unexpected event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb for instance with vm_state building and task_state spawning.
Jul 27 18:11:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481515.9988556, e8157272-448d-4844-94ed-ee577be9a5dd => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] VM Resumed (Lifecycle Event)
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Instance spawned successfully.
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481516.0024, e8157272-448d-4844-94ed-ee577be9a5dd => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] VM Started (Lifecycle Event)
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Took 6.03 seconds to spawn the instance on the hypervisor.
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] No waiting events found dispatching network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:11:56 user nova-compute[71206]: WARNING nova.compute.manager [req-316fd664-2a3e-441f-835e-ef9cf9da1bb4 req-ee42e62b-336c-418f-aa41-ccd8162f93e3 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received unexpected event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb for instance with vm_state building and task_state spawning.
Jul 27 18:11:56 user nova-compute[71206]: INFO nova.compute.manager [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Took 7.01 seconds to build instance.
Jul 27 18:11:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6181ed1d-f190-4047-913c-298af87861c4 tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.155s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:11:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:11:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:05 user nova-compute[71206]: INFO nova.compute.manager [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Unrescuing
Jul 27 18:12:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:12:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:12:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:12:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:12:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:12:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'flavor' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:06 user nova-compute[71206]: WARNING nova.compute.manager [req-1838b2a9-fcd9-4ed0-96f4-80acfdc44719 req-efdc12cc-2693-441a-83c9-755419ff4cfe service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:12:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance destroyed successfully.
Jul 27 18:12:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:08 user nova-compute[71206]: WARNING nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:12:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:08 user nova-compute[71206]: WARNING nova.compute.manager [req-1292992a-addb-400d-b85e-d37457060b69 req-3e0e0e2a-de93-466f-a40e-52ab75790593 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:12:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 0dabbb68-9356-4fed-934e-1aaa4ab46a4f due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481530.3583732, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:12:10 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Resumed (Lifecycle Event)
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cc05948b-f07e-4678-b149-94cd7bc72eda tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:10 user nova-compute[71206]: WARNING nova.compute.manager [req-05ca598b-8af5-4650-b694-4446e5e36f6b req-2ec8c70c-526e-4b36-a81b-4e055d573199 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:12:10 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481530.3641229, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:12:10 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Started (Lifecycle Event)
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:10 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'flavor' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:11 user nova-compute[71206]: INFO nova.compute.manager [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attaching volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac to /dev/vdb
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.utils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba9f0b-c352-4a1d-8dc9-0d428f5066a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d285ba15-8175-450c-bd97-4ce6ce1a3a18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd959f-2c74-476b-9ec3-8aeafe555da1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f6565-0fdf-4cf8-b5ff-28e0a5489c4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:12:11 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:12:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c36e83-81ae-48f5-bc42-df2b2b2a1402]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG os_brick.utils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:11 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating existing volume attachment record: ae192ed3-ebe1-4787-ab07-56572fcbb1dc {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:12:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:19 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:19 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:19 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600415a-338c-4f8a-8960-df28288bff35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:12:19 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5991874-eb14-4062-895c-9478989ff4c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac] added
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e45c7-06b0-4cfb-882a-c23064d80663]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6ae41-acbd-4b18-96fc-2e4117389c39]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpHJEDQS {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpHJEDQS" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081be21-1d1e-41e1-b9e0-a0e784dde083]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpHJEDQS'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[267891dc-9224-424a-a796-721eedff3495]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cf641-92c3-4eb0-943e-1e29f6b2fb2e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[620fd25d-34a7-4e6a-a07c-f8635e621312]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]
Jul 27 18:12:19 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6830c-78db-4db4-8217-626d15c0aa7d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6557467e-8fe9-4f9e-86b1-eab3bd39b599]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:19 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:19 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f839ae-5340-403f-93d7-25a4f5fad3c0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:19 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26431326434346132', 'path': '/dev/sdh'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431326434346132', 'path': '/dev/sdh'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'flavor' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:12:20 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:12:20 user nova-compute[71206]:   <source dev="/dev/sdh"/>
Jul 27 18:12:20 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:12:20 user nova-compute[71206]:   <serial>cced6d53-0210-46a0-82f4-f2bea4bbb2ac</serial>
Jul 27 18:12:20 user nova-compute[71206]: </disk>
Jul 27 18:12:20 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:12:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No VIF found with MAC fa:16:3e:ea:3f:2d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:12:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c1f55ab-ce2d-4bac-9f9e-03510b261037 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.845s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:22 user nova-compute[71206]: INFO nova.compute.manager [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Rebuilding instance
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_requests' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_devices' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'resources' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'migration_context' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:23 user nova-compute[71206]: WARNING nova.compute.manager [req-e2c5de19-6c25-4860-a963-88a88e6a050f req-f4523ad9-ac59-463d-8847-f92e4d61fbd2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state active and task_state rebuilding.
Jul 27 18:12:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance destroyed successfully.
Jul 27 18:12:23 user nova-compute[71206]: INFO nova.compute.manager [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Detaching volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:12:23 user nova-compute[71206]: INFO nova.virt.block_device [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attempting to driver detach volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac from mountpoint /dev/vdb
Jul 27 18:12:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Attempting to detach device vdb from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:12:23 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:12:23 user nova-compute[71206]:   <source dev="/dev/sdh"/>
Jul 27 18:12:23 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:12:23 user nova-compute[71206]:   <serial>cced6d53-0210-46a0-82f4-f2bea4bbb2ac</serial>
Jul 27 18:12:23 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:12:23 user nova-compute[71206]: </disk>
Jul 27 18:12:23 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:12:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully detached device vdb from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the persistent domain config.
Jul 27 18:12:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:23 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3158bebd-ab8e-48d9-a056-9e06dfe6d552]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:12:23 user nova-compute[71206]: No targets found.
Jul 27 18:12:23 user nova-compute[71206]: iSNS:
Jul 27 18:12:23 user nova-compute[71206]: No targets found.
Jul 27 18:12:23 user nova-compute[71206]: STATIC:
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e
Jul 27 18:12:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:23 user nova-compute[71206]: FIRMWARE:
Jul 27 18:12:23 user nova-compute[71206]: No targets found.
Jul 27 18:12:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:12:23 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:12:23 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17857f-6ac2-49e2-887e-e7497499901e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f0815-2832-4ccc-b48b-8e6f40065938]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:23 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c3f13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac'): ({'sdh'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Removing single pathed devices sdh {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764b8e5-8391-47af-b74e-4c71632fa13f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bdeea-4f6c-476f-a0ff-ecf92c9dad61]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flushing IO for device /dev/sdh {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63a298-4468-4f04-89e0-2cd7a06d59e0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11990b33-c4a6-4c98-a737-c6aef2a4a2d8]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:12:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129b34e-cfe2-435f-8f12-a6494ec4556a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8f551-a878-41a8-af30-921eeab9ada6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]
Jul 27 18:12:24 user nova-compute[71206]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.
Jul 27 18:12:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aacc11b-4f23-414b-b501-13f06ec310a8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== disconnect_volume: return (337ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:12:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance destroyed successfully.
Jul 27 18:12:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-131161068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397c4c09-e7, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:12:24 user nova-compute[71206]: INFO os_vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7')
Jul 27 18:12:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4565785-5c54-42fa-aaa0-8206917bdc79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:12:24 user nova-compute[71206]: No targets found.
Jul 27 18:12:24 user nova-compute[71206]: iSNS:
Jul 27 18:12:24 user nova-compute[71206]: No targets found.
Jul 27 18:12:24 user nova-compute[71206]: STATIC:
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e
Jul 27 18:12:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:12:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:12:24 user nova-compute[71206]: FIRMWARE:
Jul 27 18:12:24 user nova-compute[71206]: No targets found.
Jul 27 18:12:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:12:24 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:12:24 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:12:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09ebff-e100-46de-af6a-b14b9d297195]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f6d2f6-9fb2-4b2b-8dbf-81779eafae46]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:25 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e32934f70>, {}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Disconnecting from: [] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== disconnect_volume: return (87ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:12:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Deleting instance files /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420_del
Jul 27 18:12:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Deletion of /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420_del complete
Jul 27 18:12:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:25 user nova-compute[71206]: WARNING nova.compute.manager [req-32a21e9c-00d4-4b92-87b8-e2063f9b775c req-ccfbdf9d-6864-4598-ac45-8bca04ae3e64 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state active and task_state rebuilding.
Jul 27 18:12:25 user nova-compute[71206]: INFO nova.virt.block_device [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Booting with volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac at /dev/vdb
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38472a0-40d6-46d3-b376-7f79bb381f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943e89f-871b-4e6e-a5f0-2c08adf75000]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49afc6d4-ef22-4d29-b8b9-4b58f3e2b50d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76198fb-9a95-4d7d-bea4-35b144fdf35d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:12:25 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:12:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0c677-53a0-4439-a840-aca7bc25f688]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:25 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating existing volume attachment record: bfb2aed5-5df2-4834-9a02-110ff4209120 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:12:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:29 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:29 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:12:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [{"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-7533b699-ec8e-46e4-828e-9cc82c802dce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:12:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:12:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Creating image(s)
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk 1073741824" returned: 0 in 0.051s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Cannot resize image /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Ensure instance console log exists: /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start _get_guest_xml network_info=[{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': 'bfb2aed5-5df2-4834-9a02-110ff4209120', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4764a2f-d9e3-40e9-933f-29374922e420', 'attached_at': '', 'detached_at': '', 'volume_id': 'cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'serial': 'cced6d53-0210-46a0-82f4-f2bea4bbb2ac'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:12:33 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 18:12:33 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:12:33 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:33 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:12:33 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad739d86-7d94-4d40-8845-2fa22b9dc8e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:12:33 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da24960-2e76-44dd-89ba-48302685e766]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac] added
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fab2e1-a39f-4bf0-8202-84bd60224300]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.237s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c82a4c-7a4a-4e97-90a9-fdd858618259]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpHJEDQS {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpHJEDQS" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[665754fd-f481-4224-ac62-bbd68f664944]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpHJEDQS'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fc4ba-dd87-4fdd-92eb-f8efb214e6eb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11abf2-fe27-44f8-9a03-a3e10e76ed2d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebec618-99c9-4cd7-887e-437f7cf2bfd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]
Jul 27 18:12:34 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d03bdc-c304-449e-bd1e-ddd902b99f67]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c179e-b670-436b-bc60-97a1236f701c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:12:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:12:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.586s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b68a825-936b-4f4f-a900-cd282d65febc]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.626s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== connect_volume: return (1629ms) {'type': 'block', 'scsi_wwn': '26431326434346132', 'path': '/dev/sdh'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431326434346132', 'path': '/dev/sdh'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-131161068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:12:35 user nova-compute[71206]:   <uuid>d4764a2f-d9e3-40e9-933f-29374922e420</uuid>
Jul 27 18:12:35 user nova-compute[71206]:   <name>instance-00000019</name>
Jul 27 18:12:35 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:12:35 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:12:35 user nova-compute[71206]:   <metadata>
Jul 27 18:12:35 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:12:35 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherA-server-131161068</nova:name>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:12:33</nova:creationTime>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:12:35 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:12:35 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:owner>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:user uuid="8c1d017cd91d4121b90577b54b28fd89">tempest-ServerActionsTestOtherA-543896870-project-member</nova:user>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:project uuid="4785a59769df4f2b8e1a027469d25d79">tempest-ServerActionsTestOtherA-543896870</nova:project>
Jul 27 18:12:35 user nova-compute[71206]:       </nova:owner>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:12:35 user nova-compute[71206]:       <nova:ports>
Jul 27 18:12:35 user nova-compute[71206]:         <nova:port uuid="397c4c09-e7b6-4e5e-a4e6-36a03f7641ca">
Jul 27 18:12:35 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:12:35 user nova-compute[71206]:         </nova:port>
Jul 27 18:12:35 user nova-compute[71206]:       </nova:ports>
Jul 27 18:12:35 user nova-compute[71206]:     </nova:instance>
Jul 27 18:12:35 user nova-compute[71206]:   </metadata>
Jul 27 18:12:35 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:12:35 user nova-compute[71206]:     <system>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="serial">d4764a2f-d9e3-40e9-933f-29374922e420</entry>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="uuid">d4764a2f-d9e3-40e9-933f-29374922e420</entry>
Jul 27 18:12:35 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:12:35 user nova-compute[71206]:     </system>
Jul 27 18:12:35 user nova-compute[71206]:   </sysinfo>
Jul 27 18:12:35 user nova-compute[71206]:   <os>
Jul 27 18:12:35 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:12:35 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:12:35 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:12:35 user nova-compute[71206]:   </os>
Jul 27 18:12:35 user nova-compute[71206]:   <features>
Jul 27 18:12:35 user nova-compute[71206]:     <acpi/>
Jul 27 18:12:35 user nova-compute[71206]:     <apic/>
Jul 27 18:12:35 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:12:35 user nova-compute[71206]:   </features>
Jul 27 18:12:35 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:12:35 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:12:35 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:12:35 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:12:35 user nova-compute[71206]:   </clock>
Jul 27 18:12:35 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:12:35 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:12:35 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:12:35 user nova-compute[71206]:   </cpu>
Jul 27 18:12:35 user nova-compute[71206]:   <devices>
Jul 27 18:12:35 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:12:35 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:12:35 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk"/>
Jul 27 18:12:35 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:12:35 user nova-compute[71206]:     </disk>
Jul 27 18:12:35 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:12:35 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:12:35 user nova-compute[71206]:       <source dev="/dev/sdh"/>
Jul 27 18:12:35 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:12:35 user nova-compute[71206]:       <serial>cced6d53-0210-46a0-82f4-f2bea4bbb2ac</serial>
Jul 27 18:12:35 user nova-compute[71206]:     </disk>
Jul 27 18:12:35 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:12:35 user nova-compute[71206]:       <mac address="fa:16:3e:ea:3f:2d"/>
Jul 27 18:12:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:12:35 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:12:35 user nova-compute[71206]:       <target dev="tap397c4c09-e7"/>
Jul 27 18:12:35 user nova-compute[71206]:     </interface>
Jul 27 18:12:35 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:12:35 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/console.log" append="off"/>
Jul 27 18:12:35 user nova-compute[71206]:     </serial>
Jul 27 18:12:35 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:12:35 user nova-compute[71206]:     <video>
Jul 27 18:12:35 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:12:35 user nova-compute[71206]:     </video>
Jul 27 18:12:35 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:12:35 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:12:35 user nova-compute[71206]:     </rng>
Jul 27 18:12:35 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:12:35 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:12:35 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:12:35 user nova-compute[71206]:     </memballoon>
Jul 27 18:12:35 user nova-compute[71206]:   </devices>
Jul 27 18:12:35 user nova-compute[71206]: </domain>
Jul 27 18:12:35 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-131161068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG os_vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397c4c09-e7, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap397c4c09-e7, col_values=(('external_ids', {'iface-id': '397c4c09-e7b6-4e5e-a4e6-36a03f7641ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:3f:2d', 'vm-uuid': 'd4764a2f-d9e3-40e9-933f-29374922e420'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:35 user nova-compute[71206]: INFO os_vif [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7')
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No VIF found with MAC fa:16:3e:ea:3f:2d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:37 user nova-compute[71206]: WARNING nova.compute.manager [req-0cb8afba-0650-4766-8e34-6319cbd406b9 req-f7bb63b9-34ff-46b2-a98f-840b64cdf1f8 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state active and task_state rebuild_spawning.
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:39 user nova-compute[71206]: WARNING nova.compute.manager [req-963aa0cd-7f38-4b36-8e45-1c186ca72b96 req-130e9059-4f6e-41e3-bfa6-4495c3e657e7 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state active and task_state rebuild_spawning.
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for d4764a2f-d9e3-40e9-933f-29374922e420 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481559.4521492, d4764a2f-d9e3-40e9-933f-29374922e420 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:12:39 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] VM Resumed (Lifecycle Event)
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:12:39 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:12:39 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=6778MB free_disk=25.268760681152344GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:39 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance spawned successfully.
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:12:39 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481559.4532804, d4764a2f-d9e3-40e9-933f-29374922e420 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:12:39 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] VM Started (Lifecycle Event)
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:12:40 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7533b699-ec8e-46e4-828e-9cc82c802dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ccb00f08-4894-41f6-816f-2683b5e7315d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 73e7aae9-1e07-448d-b39a-7d37920e3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e8157272-448d-4844-94ed-ee577be9a5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.465s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b0f07da0-1b24-4ee4-baf8-7dea2bf2aa42 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:41 user nova-compute[71206]: INFO nova.compute.manager [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Terminating instance
Jul 27 18:12:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:12:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-03419fa1-e127-4847-830d-a41c04897fd8 req-c38b9a91-7fb9-40cb-81c2-8cf38da3428f service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-unplugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:12:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Instance destroyed successfully.
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lazy-loading 'resources' on Instance uuid 73e7aae9-1e07-448d-b39a-7d37920e3865 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-89295416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-89295416',id=21,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYQ3svvqiTKc7JcEvCAP3gqqCDPyxezA3aJ4J7g4CuxE3HeWVyQ5HA4JaQO5DnXk+S1dOeSgiKH/vyTY2ateEy4NJwEjE84NNEm68eYBuXk4MBfaNrNA06/pm2VGoQ9KQ==',key_name='tempest-keypair-737493504',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f383884701844a8b955177235bbbd4c',ramdisk_id='',reservation_id='r-5h7ymubg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-760609809',owner_user_name='tempest-AttachVolumeShelveTestJSON-760609809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa4ebea12dd4e89b0ae6097aae1bb7a',uuid=73e7aae9-1e07-448d-b39a-7d37920e3865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converting VIF {"id": "4f53b553-dbf5-4873-9894-07f719685b8d", "address": "fa:16:3e:1b:9a:9c", "network": {"id": "684305a4-d4eb-49af-9665-365f747ea4e7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1074258187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f383884701844a8b955177235bbbd4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f53b553-db", "ovs_interfaceid": "4f53b553-dbf5-4873-9894-07f719685b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG os_vif [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f53b553-db, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:12:42 user nova-compute[71206]: INFO os_vif [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9a:9c,bridge_name='br-int',has_traffic_filtering=True,id=4f53b553-dbf5-4873-9894-07f719685b8d,network=Network(684305a4-d4eb-49af-9665-365f747ea4e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f53b553-db')
Jul 27 18:12:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Deleting instance files /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865_del
Jul 27 18:12:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Deletion of /opt/stack/data/nova/instances/73e7aae9-1e07-448d-b39a-7d37920e3865_del complete
Jul 27 18:12:42 user nova-compute[71206]: INFO nova.compute.manager [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 27 18:12:42 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:12:42 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:12:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:12:43 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:12:43 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Took 0.90 seconds to deallocate network for instance.
Jul 27 18:12:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] Acquiring lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] No waiting events found dispatching network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:12:44 user nova-compute[71206]: WARNING nova.compute.manager [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received unexpected event network-vif-plugged-4f53b553-dbf5-4873-9894-07f719685b8d for instance with vm_state deleted and task_state None.
Jul 27 18:12:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b818ef1-4b09-490d-8f51-1dea4d085a54 req-32deb383-e9a9-4ba7-9551-1eb78175ff68 service nova] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Received event network-vif-deleted-4f53b553-dbf5-4873-9894-07f719685b8d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:12:44 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Deleted allocations for instance 73e7aae9-1e07-448d-b39a-7d37920e3865
Jul 27 18:12:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a23a5d80-edfe-4aa2-870c-a42675629200 tempest-AttachVolumeShelveTestJSON-760609809 tempest-AttachVolumeShelveTestJSON-760609809-project-member] Lock "73e7aae9-1e07-448d-b39a-7d37920e3865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:12:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:57 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481562.6887624, 73e7aae9-1e07-448d-b39a-7d37920e3865 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:12:57 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] VM Stopped (Lifecycle Event)
Jul 27 18:12:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b38c2af9-d04b-43f7-9eed-815aeee70264 None None] [instance: 73e7aae9-1e07-448d-b39a-7d37920e3865] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:12:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:12:59 user nova-compute[71206]: INFO nova.compute.manager [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Rescuing
Jul 27 18:12:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:12:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:12:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating instance_info_cache with network_info: [{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG nova.compute.manager [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:00 user nova-compute[71206]: WARNING nova.compute.manager [req-b196d700-a7d8-405e-8fe6-ec388b5a522e req-bfa12f46-1972-4f38-9936-9c975267135d service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state active and task_state rescuing.
Jul 27 18:13:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance destroyed successfully.
Jul 27 18:13:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Attempting a stable device rescue
Jul 27 18:13:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:13:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Creating image(s)
Jul 27 18:13:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'trusted_certs' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "80387b7403b6d1e7f497791d5574d591f521533a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "80387b7403b6d1e7f497791d5574d591f521533a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.part --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG nova.virt.images [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] 464ce201-2b86-49e3-9ef7-b09c81d429fa was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.part /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:02 user nova-compute[71206]: WARNING nova.compute.manager [req-a13dba8f-c165-48ae-af15-ea245db60418 req-6e00a8d0-e3f9-47e1-9083-df43ef05057b service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state active and task_state rescuing.
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.part /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.converted" returned: 0 in 0.475s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "80387b7403b6d1e7f497791d5574d591f521533a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.746s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "80387b7403b6d1e7f497791d5574d591f521533a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "80387b7403b6d1e7f497791d5574d591f521533a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a,backing_fmt=raw /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a,backing_fmt=raw /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue" returned: 0 in 0.048s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "80387b7403b6d1e7f497791d5574d591f521533a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'migration_context' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start _get_guest_xml network_info=[{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:dd:50:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '464ce201-2b86-49e3-9ef7-b09c81d429fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': 'd832e8bb-e032-4c52-97f9-5970635ace5c', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '31095d6b-990e-4fc5-ad0b-1cfed57cc0e6', 'attached_at': '', 'detached_at': '', 'volume_id': '0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'serial': '0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'numa_topology' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:03 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:13:03 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:13:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:13:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:13:03 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710db22-1184-4ea9-b7af-586083a80b8e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QwkipKUn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 18:13:03 user nova-compute[71206]: node.name = iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:13:03 user nova-compute[71206]: node.tpgt = -1
Jul 27 18:13:03 user nova-compute[71206]: node.startup = automatic
Jul 27 18:13:03 user nova-compute[71206]: node.leading_login = No
Jul 27 18:13:03 user nova-compute[71206]: iface.iscsi_ifacename = default
Jul 27 18:13:03 user nova-compute[71206]: iface.net_ifacename = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.ipaddress = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.prefix_len = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.hwaddress = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.transport_name = tcp
Jul 27 18:13:03 user nova-compute[71206]: iface.initiatorname = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.vlan_id = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.vlan_priority = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.vlan_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.iface_num = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.mtu = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.port = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.bootproto = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.subnet_mask = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.gateway = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_alt_client_id = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_dns = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_learn_iqn = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_vendor_id_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_vendor_id = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.dhcp_slp_da = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.fragmentation = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.gratuitous_arp = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.incoming_forwarding = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.tos_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.tos = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.ttl = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.delayed_ack = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.tcp_nagle = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.tcp_wsf_state = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.tcp_wsf = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.tcp_timer_scale = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.tcp_timestamp = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.redirect = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.def_task_mgmt_timeout = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.header_digest = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.data_digest = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.immediate_data = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.initial_r2t = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.data_seq_inorder = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.data_pdu_inorder = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.erl = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.max_receive_data_len = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.first_burst_len = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.max_outstanding_r2t = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.max_burst_len = 0
Jul 27 18:13:03 user nova-compute[71206]: iface.chap_auth = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.bidi_chap = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.strict_login_compliance = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.discovery_auth = <empty>
Jul 27 18:13:03 user nova-compute[71206]: iface.discovery_logout = <empty>
Jul 27 18:13:03 user nova-compute[71206]: node.discovery_address = <empty>
Jul 27 18:13:03 user nova-compute[71206]: node.discovery_port = 0
Jul 27 18:13:03 user nova-compute[71206]: node.discovery_type = static
Jul 27 18:13:03 user nova-compute[71206]: node.session.initial_cmdsn = 0
Jul 27 18:13:03 user nova-compute[71206]: node.session.initial_login_retry_max = 8
Jul 27 18:13:03 user nova-compute[71206]: node.session.xmit_thread_priority = -20
Jul 27 18:13:03 user nova-compute[71206]: node.session.cmds_max = 128
Jul 27 18:13:03 user nova-compute[71206]: node.session.queue_depth = 32
Jul 27 18:13:03 user nova-compute[71206]: node.session.nr_sessions = 1
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.authmethod = CHAP
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.username = QwkipKUn
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.password = ***
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.username_in = <empty>
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.password_in = <empty>
Jul 27 18:13:03 user nova-compute[71206]: node.session.auth.chap_algs = MD5
Jul 27 18:13:03 user nova-compute[71206]: node.session.timeo.replacement_timeout = 120
Jul 27 18:13:03 user nova-compute[71206]: node.session.err_timeo.abort_timeout = 15
Jul 27 18:13:03 user nova-compute[71206]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 18:13:03 user nova-compute[71206]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 18:13:03 user nova-compute[71206]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.FastAbort = Yes
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.InitialR2T = No
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.ImmediateData = Yes
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.MaxConnections = 1
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 18:13:03 user nova-compute[71206]: node.session.iscsi.ERL = 0
Jul 27 18:13:03 user nova-compute[71206]: node.session.scan = manual
Jul 27 18:13:03 user nova-compute[71206]: node.session.reopen_max = 0
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].address = 172.16.0.220
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].port = 3260
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].startup = manual
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].tcp.window_size = 524288
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].tcp.type_of_service = 0
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].timeo.logout_timeout = 15
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].timeo.login_timeout = 15
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].timeo.auth_timeout = 45
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.DataDigest = None
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.IFMarker = No
Jul 27 18:13:03 user nova-compute[71206]: node.conn[0].iscsi.OFMarker = No
Jul 27 18:13:03 user nova-compute[71206]: # END RECORD
Jul 27 18:13:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572a464-83cc-42a9-8c5d-965b1b5ce8b6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fce8fe-9f28-4f5f-85c6-83360f52fded]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwkipKUn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwkipKUn" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb8d33-bbe5-427d-9b4d-eecf66e5b0fa]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwkipKUn'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae1642-a43a-4b75-8bc0-c33b4c076c43]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f1038f-3764-4936-88cb-1b89a336b9fd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:03 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] HCTL ('37', '0', '0', 0) found on session 30 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3212b-1d91-4d2d-8d09-e4b7b39d3d8c]: (4, ('0 0 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Searching for a device in session 30 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '26365333133303038', 'path': '/dev/sdf'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365333133303038', 'path': '/dev/sdf'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-244505156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-244505156',id=29,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-fx5qtyqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:11:37Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=31095d6b-990e-4fc5-ad0b-1cfed57cc0e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:dd:50:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "vif_mac": "fa:16:3e:dd:50:84"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'pci_devices' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:13:03 user nova-compute[71206]:   <uuid>31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</uuid>
Jul 27 18:13:03 user nova-compute[71206]:   <name>instance-0000001d</name>
Jul 27 18:13:03 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:13:03 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:13:03 user nova-compute[71206]:   <metadata>
Jul 27 18:13:03 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:13:03 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-244505156</nova:name>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:13:03</nova:creationTime>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:13:03 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:13:03 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:owner>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:user uuid="0ed5535b566e42f195aebce82e14ced7">tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member</nova:user>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:project uuid="a72bcdbc35df444c99f3d4045832c9a8">tempest-ServerBootFromVolumeStableRescueTest-1231153209</nova:project>
Jul 27 18:13:03 user nova-compute[71206]:       </nova:owner>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:13:03 user nova-compute[71206]:       <nova:ports>
Jul 27 18:13:03 user nova-compute[71206]:         <nova:port uuid="451955c0-5b30-47e6-95e0-e562c3167201">
Jul 27 18:13:03 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 18:13:03 user nova-compute[71206]:         </nova:port>
Jul 27 18:13:03 user nova-compute[71206]:       </nova:ports>
Jul 27 18:13:03 user nova-compute[71206]:     </nova:instance>
Jul 27 18:13:03 user nova-compute[71206]:   </metadata>
Jul 27 18:13:03 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:13:03 user nova-compute[71206]:     <system>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="serial">31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</entry>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="uuid">31095d6b-990e-4fc5-ad0b-1cfed57cc0e6</entry>
Jul 27 18:13:03 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:13:03 user nova-compute[71206]:     </system>
Jul 27 18:13:03 user nova-compute[71206]:   </sysinfo>
Jul 27 18:13:03 user nova-compute[71206]:   <os>
Jul 27 18:13:03 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:13:03 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:13:03 user nova-compute[71206]:   </os>
Jul 27 18:13:03 user nova-compute[71206]:   <features>
Jul 27 18:13:03 user nova-compute[71206]:     <acpi/>
Jul 27 18:13:03 user nova-compute[71206]:     <apic/>
Jul 27 18:13:03 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:13:03 user nova-compute[71206]:   </features>
Jul 27 18:13:03 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:13:03 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:13:03 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:13:03 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:13:03 user nova-compute[71206]:   </clock>
Jul 27 18:13:03 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:13:03 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:13:03 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:13:03 user nova-compute[71206]:   </cpu>
Jul 27 18:13:03 user nova-compute[71206]:   <devices>
Jul 27 18:13:03 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:13:03 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:13:03 user nova-compute[71206]:       <source dev="/dev/sdf"/>
Jul 27 18:13:03 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:13:03 user nova-compute[71206]:       <serial>0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c</serial>
Jul 27 18:13:03 user nova-compute[71206]:     </disk>
Jul 27 18:13:03 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:13:03 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:13:03 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue"/>
Jul 27 18:13:03 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:13:03 user nova-compute[71206]:       <boot order="1"/>
Jul 27 18:13:03 user nova-compute[71206]:     </disk>
Jul 27 18:13:03 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:13:03 user nova-compute[71206]:       <mac address="fa:16:3e:dd:50:84"/>
Jul 27 18:13:03 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:13:03 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:13:03 user nova-compute[71206]:       <target dev="tap451955c0-5b"/>
Jul 27 18:13:03 user nova-compute[71206]:     </interface>
Jul 27 18:13:03 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:13:03 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/console.log" append="off"/>
Jul 27 18:13:03 user nova-compute[71206]:     </serial>
Jul 27 18:13:03 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:13:03 user nova-compute[71206]:     <video>
Jul 27 18:13:03 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:13:03 user nova-compute[71206]:     </video>
Jul 27 18:13:03 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:13:03 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:13:03 user nova-compute[71206]:     </rng>
Jul 27 18:13:03 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:13:03 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:13:03 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:13:03 user nova-compute[71206]:     </memballoon>
Jul 27 18:13:03 user nova-compute[71206]:   </devices>
Jul 27 18:13:03 user nova-compute[71206]: </domain>
Jul 27 18:13:03 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:13:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance destroyed successfully.
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] No VIF found with MAC fa:16:3e:dd:50:84, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:13:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:04 user nova-compute[71206]: WARNING nova.compute.manager [req-54cb4d14-ab45-4f62-b7e3-cb5ddf8777ef req-c783db88-2225-42a7-aaa2-1c6cbcb7fee0 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state active and task_state rescuing.
Jul 27 18:13:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-changed-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Refreshing instance network info cache due to event network-changed-9e4d5db9-0797-4180-9bf3-f26870a10b10. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] Acquiring lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] Acquired lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Refreshing network info cache for port 9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updated VIF entry in instance network info cache for port 9e4d5db9-0797-4180-9bf3-f26870a10b10. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updating instance_info_cache with network_info: [{"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9a87f6ad-fcd4-48a4-94b9-029f0e62164e req-c998a4d3-a68b-4be1-96af-2156ced3d764 service nova] Releasing lock "refresh_cache-62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:05 user nova-compute[71206]: INFO nova.compute.manager [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Terminating instance
Jul 27 18:13:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-unplugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] No waiting events found dispatching network-vif-unplugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-fd3a7ecc-d173-4d8d-8c0a-9c7bd1db4599 req-ed7e242e-4e1b-42a3-b1b4-3f157b04da91 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-unplugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:13:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Instance destroyed successfully.
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1867884095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1867884095',id=30,image_ref='9ba1f260-6b54-4071-aba7-ae6c666fc426',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCERwwmBduBNgWLbmiDtyH0z8niYqqRr1O+5/EJqNyiwMap9232rzgJ9+31pnOCXu4G1yu4SFQaNOMqTyMuJYadiAIsTaYRNC8XqnyrmPuhz35QNOk34eeX6y22BRbULZg==',key_name='tempest-keypair-677742062',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-lg7fxd88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1571765582',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "address": "fa:16:3e:45:d5:b5", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4d5db9-07", "ovs_interfaceid": "9e4d5db9-0797-4180-9bf3-f26870a10b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_vif [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e4d5db9-07, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:06 user nova-compute[71206]: INFO os_vif [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d5:b5,bridge_name='br-int',has_traffic_filtering=True,id=9e4d5db9-0797-4180-9bf3-f26870a10b10,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4d5db9-07')
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCLdYfGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:13:06 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9712d-7073-4f50-af7a-33e7c9120ca9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:13:06 user nova-compute[71206]: No targets found.
Jul 27 18:13:06 user nova-compute[71206]: iSNS:
Jul 27 18:13:06 user nova-compute[71206]: No targets found.
Jul 27 18:13:06 user nova-compute[71206]: STATIC:
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e
Jul 27 18:13:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:06 user nova-compute[71206]: FIRMWARE:
Jul 27 18:13:06 user nova-compute[71206]: No targets found.
Jul 27 18:13:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:13:06 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:13:06 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a2e08e-2c35-4843-a539-70a8fc866459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9675e3fd-972b-4cc4-8461-943e9d26cf1f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:06 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c213880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e'): ({'sdg'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdg {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5af5b0-702a-4b0a-a6ce-7aa8dbcb66c9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc645fb-5c14-475a-849b-f620e3dc463a]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdg {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2bc796-953a-4291-a895-55476a305c69]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eea559-81ba-4356-acf4-330a5b532ee9]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdg have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26331623566653638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6d233279', '/dev/disk/by-id/scsi-1SCST_BIO6d233279-c1b5fe686626dcb3') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:13:06 user nova-compute[71206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26331623566653638
Jul 27 18:13:06 user nova-compute[71206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6d233279
Jul 27 18:13:06 user nova-compute[71206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO6d233279-c1b5fe686626dcb3
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4048dd4-cf10-460e-af45-59b81216b811]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eddafe-332f-448e-b279-fae5227f8b14]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f2f3e9-c639-464d-a3fd-85c6de1ea71a]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260]
Jul 27 18:13:06 user nova-compute[71206]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e, portal: 172.16.0.220,3260] successful.
Jul 27 18:13:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b211789-d438-4247-bad7-5954a702825e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b87d4b-2fd5-4d1c-8812-22aee1fc561c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (343ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:13:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Deleting instance files /opt/stack/data/nova/instances/62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8_del
Jul 27 18:13:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Deletion of /opt/stack/data/nova/instances/62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8_del complete
Jul 27 18:13:06 user nova-compute[71206]: INFO nova.compute.manager [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 18:13:06 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:13:06 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:07 user nova-compute[71206]: WARNING nova.compute.manager [req-6ae6c28f-d5a3-440e-8015-54181d0598aa req-e95b4c51-df4b-4b4f-abaf-a7f3c6377301 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state active and task_state rescuing.
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481587.1616046, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:07 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Resumed (Lifecycle Event)
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d8b87219-8d8c-4f28-bf68-97668b4d04ea tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:13:07 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481587.163529, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:07 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Started (Lifecycle Event)
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:08 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Took 1.10 seconds to deallocate network for instance.
Jul 27 18:13:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] Acquiring lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] No waiting events found dispatching network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:08 user nova-compute[71206]: WARNING nova.compute.manager [req-a713e9ce-8c5c-4caa-80a2-b5e7b6d54d76 req-8b8adfd8-cfc8-478d-b4be-8ff09bbdefff service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received unexpected event network-vif-plugged-9e4d5db9-0797-4180-9bf3-f26870a10b10 for instance with vm_state active and task_state deleting.
Jul 27 18:13:08 user nova-compute[71206]: INFO nova.compute.manager [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Took 0.79 seconds to detach 1 volumes for instance.
Jul 27 18:13:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Deleting volume: 5b211789-d438-4247-bad7-5954a702825e {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf49e6c5-cad1-43cf-ace3-6cb7b8892461 req-2cd986aa-06ad-47dc-882b-fb338c6ae025 service nova] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Received event network-vif-deleted-9e4d5db9-0797-4180-9bf3-f26870a10b10 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:13:09 user nova-compute[71206]: INFO nova.compute.manager [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Terminating instance
Jul 27 18:13:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:09 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8
Jul 27 18:13:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a4ef38a-1bdc-48df-a44f-cb09512673e5 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.932s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:10 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Instance destroyed successfully.
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.objects.instance [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'resources' on Instance uuid 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1371894754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1822567350',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7WJx4U9VhaO45/xqKdClPGOLqAM6VffESGCmtkx27Y1yNr3Gys6bRW9TmJBORnvMadWlQs8IP2e+lQLdU08dWr36AL//CnKEYFoFWlctWbe9viAJTr7xdPNyB5YY9Y9w==',key_name='tempest-keypair-2050587901',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-pq9fguzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=8f6ee1d9-26cc-483e-b880-32b74f8a75f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "ba625d39-b403-4879-890b-b86da4fbdce6", "address": "fa:16:3e:9b:ff:a3", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625d39-b4", "ovs_interfaceid": "ba625d39-b403-4879-890b-b86da4fbdce6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_vif [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba625d39-b4, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:13:10 user nova-compute[71206]: INFO os_vif [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:ff:a3,bridge_name='br-int',has_traffic_filtering=True,id=ba625d39-b403-4879-890b-b86da4fbdce6,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba625d39-b4')
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlNIidrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:13:10 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f2190-773f-44e6-a51e-a36b9e75472c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:13:10 user nova-compute[71206]: No targets found.
Jul 27 18:13:10 user nova-compute[71206]: iSNS:
Jul 27 18:13:10 user nova-compute[71206]: No targets found.
Jul 27 18:13:10 user nova-compute[71206]: STATIC:
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:13:10 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:10 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:10 user nova-compute[71206]: FIRMWARE:
Jul 27 18:13:10 user nova-compute[71206]: No targets found.
Jul 27 18:13:10 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:13:10 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:13:10 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9e2a2-f54d-4f70-8173-1148ede8ff73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2034095-fe9b-42b3-8c32-460a097171cd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:10 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:10 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:10 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c209630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-unplugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Acquiring lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] No waiting events found dispatching network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:10 user nova-compute[71206]: WARNING nova.compute.manager [req-c81b8b1d-e60e-4fc6-9d1d-2ce47f093eea req-7993d6eb-7fba-4d68-b29d-e9a685c19662 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received unexpected event network-vif-plugged-ba625d39-b403-4879-890b-b86da4fbdce6 for instance with vm_state active and task_state deleting.
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebac06f-addd-4d47-8b86-8d21b60b55ca]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72a9367-0963-4a40-a2ed-78be61479b95]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[badfa273-fd62-490b-8dcc-02024351dc0e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37587b-2291-4399-aaed-352929c5a43a]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23765613462326338', '/dev/disk/by-id/scsi-1SCST_BIO667bcb1f-7ea4b2c85a158049', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_667bcb1f') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ef00b-1d55-43d1-9568-743516425bb7]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631466f-f4db-4b26-8758-a0c662419227]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6265178-b5f0-4787-8061-6083832277c6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260]
Jul 27 18:13:10 user nova-compute[71206]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555, portal: 172.16.0.220,3260] successful.
Jul 27 18:13:10 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c431fc05-bf9b-4ffd-853e-2bc6c260b555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2244e26a-3f8d-4a78-85fd-e91837034411]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] <== disconnect_volume: return (341ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:13:10 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deleting instance files /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4_del
Jul 27 18:13:10 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deletion of /opt/stack/data/nova/instances/8f6ee1d9-26cc-483e-b880-32b74f8a75f4_del complete
Jul 27 18:13:10 user nova-compute[71206]: INFO nova.compute.manager [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 27 18:13:10 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:13:10 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:13:12 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:12 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Took 1.40 seconds to deallocate network for instance.
Jul 27 18:13:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-d22619c2-aca0-4152-a6dc-075d7dbdd4df req-5e6b82bc-18f4-4511-ad9b-387f20fde5e9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Received event network-vif-deleted-ba625d39-b403-4879-890b-b86da4fbdce6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:12 user nova-compute[71206]: INFO nova.compute.manager [req-d22619c2-aca0-4152-a6dc-075d7dbdd4df req-5e6b82bc-18f4-4511-ad9b-387f20fde5e9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Neutron deleted interface ba625d39-b403-4879-890b-b86da4fbdce6; detaching it from the instance and deleting it from the info cache
Jul 27 18:13:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-d22619c2-aca0-4152-a6dc-075d7dbdd4df req-5e6b82bc-18f4-4511-ad9b-387f20fde5e9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-d22619c2-aca0-4152-a6dc-075d7dbdd4df req-5e6b82bc-18f4-4511-ad9b-387f20fde5e9 service nova] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Detach interface failed, port_id=ba625d39-b403-4879-890b-b86da4fbdce6, reason: Instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:13:12 user nova-compute[71206]: INFO nova.compute.manager [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Took 0.76 seconds to detach 1 volumes for instance.
Jul 27 18:13:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Deleting volume: c431fc05-bf9b-4ffd-853e-2bc6c260b555 {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:13:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:13 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:13:13 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:13:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:13 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Deleted allocations for instance 8f6ee1d9-26cc-483e-b880-32b74f8a75f4
Jul 27 18:13:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70a9c4e4-0b4b-4864-a123-1b188c391b8c tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "8f6ee1d9-26cc-483e-b880-32b74f8a75f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.104s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:19 user nova-compute[71206]: INFO nova.compute.manager [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Terminating instance
Jul 27 18:13:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-14cb924f-7ef3-4556-9947-0bc29a8b2204 req-2618bd0f-766b-4f23-8cf3-cf9b87b20a1a service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-unplugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:13:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Instance destroyed successfully.
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'resources' on Instance uuid 7533b699-ec8e-46e4-828e-9cc82c802dce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1846081917',display_name='tempest-AttachVolumeTestJSON-server-1846081917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1846081917',id=17,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoar4TdX/sqRUPORy4a09b7pplEZzFPeRz0jsyXkkoyz0fW4EXKbNuAfV04t38MmRpsQlF8CyUm1iomDdbpgz086wOmXPfWVHyjQzm6jd38YemcWEqlI6EhWGcqQZ82XQ==',key_name='tempest-keypair-495592342',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-elv7wjab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=7533b699-ec8e-46e4-828e-9cc82c802dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "address": "fa:16:3e:97:c1:c7", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e52ab25-92", "ovs_interfaceid": "7e52ab25-92dd-4d48-9037-a402f9f3c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG os_vif [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e52ab25-92, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:20 user nova-compute[71206]: INFO os_vif [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c1:c7,bridge_name='br-int',has_traffic_filtering=True,id=7e52ab25-92dd-4d48-9037-a402f9f3c98b,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e52ab25-92')
Jul 27 18:13:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Deleting instance files /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce_del
Jul 27 18:13:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Deletion of /opt/stack/data/nova/instances/7533b699-ec8e-46e4-828e-9cc82c802dce_del complete
Jul 27 18:13:20 user nova-compute[71206]: INFO nova.compute.manager [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 18:13:20 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:13:20 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:21 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Took 0.92 seconds to deallocate network for instance.
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481586.5028613, 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:21 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] VM Stopped (Lifecycle Event)
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-cafad745-3e9f-484e-a9ad-6e07506a02ce None None] [instance: 62e6f86d-9ccc-4ba4-ac82-6c2a205b88a8] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:21 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Deleted allocations for instance 7533b699-ec8e-46e4-828e-9cc82c802dce
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] Acquiring lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] No waiting events found dispatching network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:21 user nova-compute[71206]: WARNING nova.compute.manager [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received unexpected event network-vif-plugged-7e52ab25-92dd-4d48-9037-a402f9f3c98b for instance with vm_state deleted and task_state None.
Jul 27 18:13:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-88ac2755-7d95-438c-9332-c26955633b69 req-8ae3e98c-33e2-4068-b02c-b43fe2c98541 service nova] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Received event network-vif-deleted-7e52ab25-92dd-4d48-9037-a402f9f3c98b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4cbbc79e-52c9-403d-9021-e1c3eea33317 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "7533b699-ec8e-46e4-828e-9cc82c802dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:25 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481590.2461681, 8f6ee1d9-26cc-483e-b880-32b74f8a75f4 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:25 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] VM Stopped (Lifecycle Event)
Jul 27 18:13:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d72b62ec-b57c-4cf0-af5a-7ec2e741fddf None None] [instance: 8f6ee1d9-26cc-483e-b880-32b74f8a75f4] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:31 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updating instance_info_cache with network_info: [{"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-29c8709b-3c27-4319-a213-b09ea02c8ef2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:13:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481600.0593922, 7533b699-ec8e-46e4-828e-9cc82c802dce => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:35 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] VM Stopped (Lifecycle Event)
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-03e5d2e0-66cf-41d6-a4c4-73aa6751df11 None None] [instance: 7533b699-ec8e-46e4-828e-9cc82c802dce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:13:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:13:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:13:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=25.198596954345703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 29c8709b-3c27-4319-a213-b09ea02c8ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ccb00f08-4894-41f6-816f-2683b5e7315d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e8157272-448d-4844-94ed-ee577be9a5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:39 user nova-compute[71206]: INFO nova.compute.manager [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Terminating instance
Jul 27 18:13:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-unplugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] No waiting events found dispatching network-vif-unplugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.compute.manager [req-05406861-ed38-4f2f-b6d0-652e85c746e6 req-efc42ef8-0ea0-456c-8f9f-bf64a13d3754 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-unplugged-080e628e-49bc-4556-8b80-2d5e3d928eeb for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Instance destroyed successfully.
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lazy-loading 'resources' on Instance uuid e8157272-448d-4844-94ed-ee577be9a5dd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1103268985',display_name='tempest-VolumesActionsTest-instance-1103268985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1103268985',id=31,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7618aaed15347c7ad497b5676c136eb',ramdisk_id='',reservation_id='r-ueyl23w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-754244769',owner_user_name='tempest-VolumesActionsTest-754244769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:11:56Z,user_data=None,user_id='5dce6f9174404f8ea1acfc078ffbaca9',uuid=e8157272-448d-4844-94ed-ee577be9a5dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converting VIF {"id": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "address": "fa:16:3e:1f:3e:12", "network": {"id": "933b2b4f-d22f-445e-8b15-da967b22e7b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100743449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7618aaed15347c7ad497b5676c136eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap080e628e-49", "ovs_interfaceid": "080e628e-49bc-4556-8b80-2d5e3d928eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG os_vif [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap080e628e-49, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:13:40 user nova-compute[71206]: INFO os_vif [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:3e:12,bridge_name='br-int',has_traffic_filtering=True,id=080e628e-49bc-4556-8b80-2d5e3d928eeb,network=Network(933b2b4f-d22f-445e-8b15-da967b22e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap080e628e-49')
Jul 27 18:13:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Deleting instance files /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd_del
Jul 27 18:13:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Deletion of /opt/stack/data/nova/instances/e8157272-448d-4844-94ed-ee577be9a5dd_del complete
Jul 27 18:13:40 user nova-compute[71206]: INFO nova.compute.manager [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 18:13:40 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:13:40 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:13:41 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:41 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Took 0.77 seconds to deallocate network for instance.
Jul 27 18:13:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:41 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:13:41 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:13:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:41 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Deleted allocations for instance e8157272-448d-4844-94ed-ee577be9a5dd
Jul 27 18:13:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bd7504b3-2816-47a6-8fd5-cbd6c20033bf tempest-VolumesActionsTest-754244769 tempest-VolumesActionsTest-754244769-project-member] Lock "e8157272-448d-4844-94ed-ee577be9a5dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] Acquiring lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] Lock "e8157272-448d-4844-94ed-ee577be9a5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:13:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] No waiting events found dispatching network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:13:42 user nova-compute[71206]: WARNING nova.compute.manager [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received unexpected event network-vif-plugged-080e628e-49bc-4556-8b80-2d5e3d928eeb for instance with vm_state deleted and task_state None.
Jul 27 18:13:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f771184-dee0-47f4-86ad-0e622ffba690 req-f71d7db7-b1ef-43b0-8c66-601b44a5f579 service nova] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Received event network-vif-deleted-080e628e-49bc-4556-8b80-2d5e3d928eeb {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:44 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:13:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:55 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481620.5285578, e8157272-448d-4844-94ed-ee577be9a5dd => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:13:55 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] VM Stopped (Lifecycle Event)
Jul 27 18:13:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9120fc65-4c0d-4392-894e-80c201e56ce3 None None] [instance: e8157272-448d-4844-94ed-ee577be9a5dd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:13:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing instance network info cache due to event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updated VIF entry in instance network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:13:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c830ece5-18f2-4acb-9a4d-f7a055a0e548 req-7eb8d4d0-a23a-4f8f-90ca-389cc4587bdd service nova] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:13:58 user nova-compute[71206]: INFO nova.compute.manager [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Detaching volume 45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:13:58 user nova-compute[71206]: INFO nova.virt.block_device [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Attempting to driver detach volume 45174623-7b49-48b9-9373-86685f4d3a4a from mountpoint /dev/vdb
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Attempting to detach device vdb from instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:13:58 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:13:58 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:13:58 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:13:58 user nova-compute[71206]:   <serial>45174623-7b49-48b9-9373-86685f4d3a4a</serial>
Jul 27 18:13:58 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:13:58 user nova-compute[71206]: </disk>
Jul 27 18:13:58 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:13:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully detached device vdb from instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f from the persistent domain config.
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:13:58 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:13:58 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:13:58 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:13:58 user nova-compute[71206]:   <serial>45174623-7b49-48b9-9373-86685f4d3a4a</serial>
Jul 27 18:13:58 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:13:58 user nova-compute[71206]: </disk>
Jul 27 18:13:58 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481638.765475, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:13:58 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully detached device vdb from instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f from the live domain config.
Jul 27 18:13:58 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUervbLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:13:58 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1e0343-84de-455a-8650-47e712bf98de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:13:58 user nova-compute[71206]: No targets found.
Jul 27 18:13:58 user nova-compute[71206]: iSNS:
Jul 27 18:13:58 user nova-compute[71206]: No targets found.
Jul 27 18:13:58 user nova-compute[71206]: STATIC:
Jul 27 18:13:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:13:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a
Jul 27 18:13:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:13:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:13:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:58 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:13:58 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:13:58 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:13:58 user nova-compute[71206]: FIRMWARE:
Jul 27 18:13:58 user nova-compute[71206]: No targets found.
Jul 27 18:13:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:13:58 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:13:58 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692cbbf-9149-4798-a40e-ffe464fbbad2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187acab-08b7-4467-83f3-bc8c339c0cf9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:13:58 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:13:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e2d171990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d09c7b-120b-4696-ba4e-0187a9955230]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de72c18-9002-4c88-8f58-68b57d6b81dd]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5da6cd-ebca-4cb1-94ed-fd13f57f1ac9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a1dbb-a857-48d4-bd8d-5c4ae3047829]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66ec133-d37e-4486-b39f-695a3c491039]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ca91c-da0b-4b4f-b9d8-502b376cc43c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260]
Jul 27 18:13:59 user nova-compute[71206]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a, portal: 172.16.0.220,3260] successful.
Jul 27 18:13:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45174623-7b49-48b9-9373-86685f4d3a4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae926159-9c31-4ca0-bf76-e32f7ddeb009]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] <== disconnect_volume: return (369ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing instance network info cache due to event network-changed-aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] Acquiring lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] Acquired lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG nova.network.neutron [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Refreshing network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:13:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'flavor' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f167bbc4-a53b-4b6c-bc5a-81566d1e21e9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updated VIF entry in instance network info cache for port aeeaca26-bc1b-472f-90b0-766855bf8ea2. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:14:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [{"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-76fab2af-f1c2-4b4b-aa29-f8be2f614093 req-cf52f58e-7fed-472a-a05e-8f2bfea21a9e service nova] Releasing lock "refresh_cache-0dabbb68-9356-4fed-934e-1aaa4ab46a4f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:01 user nova-compute[71206]: INFO nova.compute.manager [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Terminating instance
Jul 27 18:14:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:01 user nova-compute[71206]: INFO nova.compute.manager [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Terminating instance
Jul 27 18:14:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-unplugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] No waiting events found dispatching network-vif-unplugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-2b8a9f33-ad6b-43a1-b41c-ff1c28c323b9 req-2f1f395d-8dc0-4498-9af4-ada28d3ba843 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-unplugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:14:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Instance destroyed successfully.
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lazy-loading 'resources' on Instance uuid 29c8709b-3c27-4319-a213-b09ea02c8ef2 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2017941253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2017941253',id=22,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkOZCh6gXfCmFzT0wCTE3gtkGPmTkCRsB73xg/VudTt8ICLrYHezkAa7CIfXiLeJJSb2E2pxQJMgsCsaMnCbcQYsrTnAVhjkuY8Zc1tM9vAzpSZZpd1MMvmrwinUnWfXg==',key_name='tempest-keypair-2131516019',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bcbc7c97e64b3cbfa2b488963e7ed4',ramdisk_id='',reservation_id='r-ne9hkwa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-806702460',owner_user_name='tempest-ServerActionsV293TestJSON-806702460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabbb175332e41a8b21867f294e13803',uuid=29c8709b-3c27-4319-a213-b09ea02c8ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converting VIF {"id": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "address": "fa:16:3e:c0:71:b2", "network": {"id": "199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1965844981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bcbc7c97e64b3cbfa2b488963e7ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff976c3-ac", "ovs_interfaceid": "fff976c3-ac38-4b84-9427-fe4a9c8b7b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_vif [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfff976c3-ac, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: INFO os_vif [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:71:b2,bridge_name='br-int',has_traffic_filtering=True,id=fff976c3-ac38-4b84-9427-fe4a9c8b7b40,network=Network(199ff68e-e8d2-49b1-9cfa-8c3bdf46ce8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff976c3-ac')
Jul 27 18:14:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Deleting instance files /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2_del
Jul 27 18:14:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Deletion of /opt/stack/data/nova/instances/29c8709b-3c27-4319-a213-b09ea02c8ef2_del complete
Jul 27 18:14:02 user nova-compute[71206]: INFO nova.compute.manager [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Took 0.81 seconds to destroy the instance on the hypervisor.
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:14:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Instance destroyed successfully.
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid ccb00f08-4894-41f6-816f-2683b5e7315d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-179221980',display_name='tempest-TestVolumeBootPattern-volume-backed-server-179221980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-179221980',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8e8pxkEL6Gap48apm/d3MHo/7Y2ivRkUqHlvZADckelgGD69Y3jjM/i0BrALPZ0q01bTFg3WLqWZRvrO+/7allBoXEkFRuvdBqyxfj1t+oIbXN/CBtdlA7MnF4WSr0Q==',key_name='tempest-keypair-344601941',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-ynedcth7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27abded262da493aa617c1c4b3fc86ec',uuid=ccb00f08-4894-41f6-816f-2683b5e7315d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "72e05315-8617-459d-af5a-aed58e28fcfe", "address": "fa:16:3e:c7:5c:7c", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e05315-86", "ovs_interfaceid": "72e05315-8617-459d-af5a-aed58e28fcfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_vif [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e05315-86, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:14:02 user nova-compute[71206]: INFO os_vif [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=72e05315-8617-459d-af5a-aed58e28fcfe,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e05315-86')
Jul 27 18:14:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MukGByAO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:14:02 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14197402-839b-4ce3-aad2-34b474568a89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:14:02 user nova-compute[71206]: No targets found.
Jul 27 18:14:02 user nova-compute[71206]: iSNS:
Jul 27 18:14:02 user nova-compute[71206]: No targets found.
Jul 27 18:14:02 user nova-compute[71206]: STATIC:
Jul 27 18:14:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1
Jul 27 18:14:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:14:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:14:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:14:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:14:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:14:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:14:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:14:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:14:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:14:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:14:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:14:02 user nova-compute[71206]: FIRMWARE:
Jul 27 18:14:02 user nova-compute[71206]: No targets found.
Jul 27 18:14:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:14:02 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:14:02 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d7270-648e-4136-8bac-ec97ac973826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f427182-872e-43e1-a95a-d2173bfa226e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:14:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:14:02 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:14:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24265cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83b3ec-ec5d-45da-a7b7-f3482bd30970]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc67e22-17a1-4e0d-acda-09b8d8c50e82]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c4d4b-3df2-4a3f-bd7a-45708a198066]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8c578f-a112-4f25-b018-36b895ce857f]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ca24a8b-a7c2b797171eed13', '/dev/disk/by-id/scsi-26137633262373937', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ca24a8b') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a2b33f-e8ea-4fc0-ba73-ad775fed88aa]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f419eb5e-0c65-437c-80ae-85733992785e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ad3a3-a608-49dd-872a-5d3980761420]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260]
Jul 27 18:14:02 user nova-compute[71206]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1, portal: 172.16.0.220,3260] successful.
Jul 27 18:14:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:14:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6c7f32-c640-4c06-9581-0d04a2402ac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61091e66-2c53-4087-a309-8a7f9a17899a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (380ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:14:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Deleting instance files /opt/stack/data/nova/instances/ccb00f08-4894-41f6-816f-2683b5e7315d_del
Jul 27 18:14:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Deletion of /opt/stack/data/nova/instances/ccb00f08-4894-41f6-816f-2683b5e7315d_del complete
Jul 27 18:14:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:03 user nova-compute[71206]: INFO nova.compute.manager [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 27 18:14:03 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:14:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Acquiring lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] No waiting events found dispatching network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:04 user nova-compute[71206]: WARNING nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received unexpected event network-vif-plugged-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 for instance with vm_state active and task_state deleting.
Jul 27 18:14:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-unplugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] No waiting events found dispatching network-vif-unplugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-508ba4d3-560a-455e-a62b-d961626e6155 req-ffae57cd-29ee-4077-bc2f-0f0c6db264e4 service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-unplugged-72e05315-8617-459d-af5a-aed58e28fcfe for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:05 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Took 2.89 seconds to deallocate network for instance.
Jul 27 18:14:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:05 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Deleted allocations for instance 29c8709b-3c27-4319-a213-b09ea02c8ef2
Jul 27 18:14:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb815167-ecf2-498c-b270-9b6401746030 tempest-ServerActionsV293TestJSON-806702460 tempest-ServerActionsV293TestJSON-806702460-project-member] Lock "29c8709b-3c27-4319-a213-b09ea02c8ef2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.215s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:05 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:05 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Took 2.68 seconds to deallocate network for instance.
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:14:06 user nova-compute[71206]: INFO nova.compute.claims [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Claim successful on node user
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] Acquiring lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] No waiting events found dispatching network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:06 user nova-compute[71206]: WARNING nova.compute.manager [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received unexpected event network-vif-plugged-72e05315-8617-459d-af5a-aed58e28fcfe for instance with vm_state active and task_state deleting.
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Received event network-vif-deleted-fff976c3-ac38-4b84-9427-fe4a9c8b7b40 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-3eab68ae-2269-4824-9c1c-9731832cbc95 req-6ce22c4e-b97d-40c9-a170-d0e39cf90daa service nova] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Received event network-vif-deleted-72e05315-8617-459d-af5a-aed58e28fcfe {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:14:06 user nova-compute[71206]: INFO nova.compute.manager [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Took 0.98 seconds to detach 1 volumes for instance.
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Deleting volume: dc6c7f32-c640-4c06-9581-0d04a2402ac1 {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:14:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.policy [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcff4a7fea7242f7b2c98f14dc24c116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79cab68c291407eb98ea332f5d2c243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:14:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Creating image(s)
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "/opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "/opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk 1073741824" returned: 0 in 0.066s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.624s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:07 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance ccb00f08-4894-41f6-816f-2683b5e7315d
Jul 27 18:14:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Successfully created port: ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Cannot resize image /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lazy-loading 'migration_context' on Instance uuid 0dcd7bf6-06d1-4399-904f-2ad23859c875 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Ensure instance console log exists: /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89e47723-015c-488a-b387-ed288ff6bc70 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "ccb00f08-4894-41f6-816f-2683b5e7315d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.895s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Successfully updated port: ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquired lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-changed-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Refreshing instance network info cache due to event network-changed-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] Acquiring lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Updating instance_info_cache with network_info: [{"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Releasing lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Instance network_info: |[{"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] Acquired lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Refreshing network info cache for port ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Start _get_guest_xml network_info=[{"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:14:08 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:08 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:14:08 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006759328',display_name='tempest-VolumesActionsTest-instance-2006759328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006759328',id=32,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d79cab68c291407eb98ea332f5d2c243',ramdisk_id='',reservation_id='r-12gucrlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1689587246',owner_user_name='tempest-VolumesActionsTest-1689587246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:14:07Z,user_data=None,user_id='dcff4a7fea7242f7b2c98f14dc24c116',uuid=0dcd7bf6-06d1-4399-904f-2ad23859c875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converting VIF {"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dcd7bf6-06d1-4399-904f-2ad23859c875 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:14:09 user nova-compute[71206]:   <uuid>0dcd7bf6-06d1-4399-904f-2ad23859c875</uuid>
Jul 27 18:14:09 user nova-compute[71206]:   <name>instance-00000020</name>
Jul 27 18:14:09 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:14:09 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:14:09 user nova-compute[71206]:   <metadata>
Jul 27 18:14:09 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:14:09 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:name>tempest-VolumesActionsTest-instance-2006759328</nova:name>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:14:08</nova:creationTime>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:14:09 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:14:09 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:owner>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:user uuid="dcff4a7fea7242f7b2c98f14dc24c116">tempest-VolumesActionsTest-1689587246-project-member</nova:user>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:project uuid="d79cab68c291407eb98ea332f5d2c243">tempest-VolumesActionsTest-1689587246</nova:project>
Jul 27 18:14:09 user nova-compute[71206]:       </nova:owner>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:14:09 user nova-compute[71206]:       <nova:ports>
Jul 27 18:14:09 user nova-compute[71206]:         <nova:port uuid="ce7bc56e-f8f6-49a4-ab27-fc320ebf658c">
Jul 27 18:14:09 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:14:09 user nova-compute[71206]:         </nova:port>
Jul 27 18:14:09 user nova-compute[71206]:       </nova:ports>
Jul 27 18:14:09 user nova-compute[71206]:     </nova:instance>
Jul 27 18:14:09 user nova-compute[71206]:   </metadata>
Jul 27 18:14:09 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:14:09 user nova-compute[71206]:     <system>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="serial">0dcd7bf6-06d1-4399-904f-2ad23859c875</entry>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="uuid">0dcd7bf6-06d1-4399-904f-2ad23859c875</entry>
Jul 27 18:14:09 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:14:09 user nova-compute[71206]:     </system>
Jul 27 18:14:09 user nova-compute[71206]:   </sysinfo>
Jul 27 18:14:09 user nova-compute[71206]:   <os>
Jul 27 18:14:09 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:14:09 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:14:09 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:14:09 user nova-compute[71206]:   </os>
Jul 27 18:14:09 user nova-compute[71206]:   <features>
Jul 27 18:14:09 user nova-compute[71206]:     <acpi/>
Jul 27 18:14:09 user nova-compute[71206]:     <apic/>
Jul 27 18:14:09 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:14:09 user nova-compute[71206]:   </features>
Jul 27 18:14:09 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:14:09 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:14:09 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:14:09 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:14:09 user nova-compute[71206]:   </clock>
Jul 27 18:14:09 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:14:09 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:14:09 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:14:09 user nova-compute[71206]:   </cpu>
Jul 27 18:14:09 user nova-compute[71206]:   <devices>
Jul 27 18:14:09 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:14:09 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:14:09 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk"/>
Jul 27 18:14:09 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:14:09 user nova-compute[71206]:     </disk>
Jul 27 18:14:09 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:14:09 user nova-compute[71206]:       <mac address="fa:16:3e:2d:02:0b"/>
Jul 27 18:14:09 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:14:09 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:14:09 user nova-compute[71206]:       <target dev="tapce7bc56e-f8"/>
Jul 27 18:14:09 user nova-compute[71206]:     </interface>
Jul 27 18:14:09 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:14:09 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/console.log" append="off"/>
Jul 27 18:14:09 user nova-compute[71206]:     </serial>
Jul 27 18:14:09 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:14:09 user nova-compute[71206]:     <video>
Jul 27 18:14:09 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:14:09 user nova-compute[71206]:     </video>
Jul 27 18:14:09 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:14:09 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:14:09 user nova-compute[71206]:     </rng>
Jul 27 18:14:09 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:14:09 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:14:09 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:14:09 user nova-compute[71206]:     </memballoon>
Jul 27 18:14:09 user nova-compute[71206]:   </devices>
Jul 27 18:14:09 user nova-compute[71206]: </domain>
Jul 27 18:14:09 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006759328',display_name='tempest-VolumesActionsTest-instance-2006759328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006759328',id=32,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d79cab68c291407eb98ea332f5d2c243',ramdisk_id='',reservation_id='r-12gucrlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1689587246',owner_user_name='tempest-VolumesActionsTest-1689587246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:14:07Z,user_data=None,user_id='dcff4a7fea7242f7b2c98f14dc24c116',uuid=0dcd7bf6-06d1-4399-904f-2ad23859c875,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converting VIF {"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG os_vif [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce7bc56e-f8, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce7bc56e-f8, col_values=(('external_ids', {'iface-id': 'ce7bc56e-f8f6-49a4-ab27-fc320ebf658c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:02:0b', 'vm-uuid': '0dcd7bf6-06d1-4399-904f-2ad23859c875'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:09 user nova-compute[71206]: INFO os_vif [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8')
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] No VIF found with MAC fa:16:3e:2d:02:0b, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Updated VIF entry in instance network info cache for port ce7bc56e-f8f6-49a4-ab27-fc320ebf658c. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Updating instance_info_cache with network_info: [{"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bad6a47d-f075-4b5e-bf17-da0a713dcc63 req-2c4b9af1-c499-4985-87ea-39e67173d908 service nova] Releasing lock "refresh_cache-0dcd7bf6-06d1-4399-904f-2ad23859c875" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] No waiting events found dispatching network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:10 user nova-compute[71206]: WARNING nova.compute.manager [req-a8060f1e-3526-4e74-9318-0b39a1a19248 req-7b77791d-08e9-4c07-96ae-50296fd0285b service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received unexpected event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c for instance with vm_state building and task_state spawning.
Jul 27 18:14:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481652.6020536, 0dcd7bf6-06d1-4399-904f-2ad23859c875 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] VM Resumed (Lifecycle Event)
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Instance spawned successfully.
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481652.6043463, 0dcd7bf6-06d1-4399-904f-2ad23859c875 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] VM Started (Lifecycle Event)
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Took 5.80 seconds to spawn the instance on the hypervisor.
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:12 user nova-compute[71206]: INFO nova.compute.manager [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Took 6.59 seconds to build instance.
Jul 27 18:14:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4f71639a-7a55-4a2c-b30d-5e49e534c367 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] No waiting events found dispatching network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:12 user nova-compute[71206]: WARNING nova.compute.manager [req-ba4d9de0-487e-4451-b022-03a59bf543fc req-982007ce-05cb-441f-9d24-00437975bc57 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received unexpected event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c for instance with vm_state active and task_state None.
Jul 27 18:14:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:14:13 user nova-compute[71206]: INFO nova.compute.claims [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Claim successful on node user
Jul 27 18:14:13 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:14:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.policy [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'faa59a3fcaa042999a5f0c357a5ef42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd626aa35a645b5b9ce1f5bf9652c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:14:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Creating image(s)
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "/opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "/opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk 1073741824" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Cannot resize image /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'migration_context' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Ensure instance console log exists: /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Successfully created port: 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Successfully updated port: 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquired lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-changed-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Refreshing instance network info cache due to event network-changed-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] Acquiring lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating instance_info_cache with network_info: [{"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Releasing lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Instance network_info: |[{"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] Acquired lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Refreshing network info cache for port 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Start _get_guest_xml network_info=[{"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:14:16 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:16 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1353941570',display_name='tempest-AttachVolumeTestJSON-server-1353941570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1353941570',id=33,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7V+g+M6WeMwTiP2gIgDj/fYC3KrYFDaopxVkwDwFW8epcpD0OOsTjsLSOdLRULdp66gvkEcYy8312Kl+iYsJ14hP1yOAAWL+LpzbkSsHq5MojtxPpH6WH3JUKXc4p9vg==',key_name='tempest-keypair-2116423901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-fcihkavh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=e4e4ffe0-0c33-43b5-84bc-91fb7f63b019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'pci_devices' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:14:16 user nova-compute[71206]:   <uuid>e4e4ffe0-0c33-43b5-84bc-91fb7f63b019</uuid>
Jul 27 18:14:16 user nova-compute[71206]:   <name>instance-00000021</name>
Jul 27 18:14:16 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:14:16 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:14:16 user nova-compute[71206]:   <metadata>
Jul 27 18:14:16 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:14:16 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1353941570</nova:name>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:14:16</nova:creationTime>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:14:16 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:14:16 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:owner>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:user uuid="faa59a3fcaa042999a5f0c357a5ef42c">tempest-AttachVolumeTestJSON-497623291-project-member</nova:user>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:project uuid="7cd626aa35a645b5b9ce1f5bf9652c79">tempest-AttachVolumeTestJSON-497623291</nova:project>
Jul 27 18:14:16 user nova-compute[71206]:       </nova:owner>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:14:16 user nova-compute[71206]:       <nova:ports>
Jul 27 18:14:16 user nova-compute[71206]:         <nova:port uuid="2877a5ab-6489-44f2-97ca-9ff3dcb3fad6">
Jul 27 18:14:16 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:14:16 user nova-compute[71206]:         </nova:port>
Jul 27 18:14:16 user nova-compute[71206]:       </nova:ports>
Jul 27 18:14:16 user nova-compute[71206]:     </nova:instance>
Jul 27 18:14:16 user nova-compute[71206]:   </metadata>
Jul 27 18:14:16 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:14:16 user nova-compute[71206]:     <system>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="serial">e4e4ffe0-0c33-43b5-84bc-91fb7f63b019</entry>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="uuid">e4e4ffe0-0c33-43b5-84bc-91fb7f63b019</entry>
Jul 27 18:14:16 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:14:16 user nova-compute[71206]:     </system>
Jul 27 18:14:16 user nova-compute[71206]:   </sysinfo>
Jul 27 18:14:16 user nova-compute[71206]:   <os>
Jul 27 18:14:16 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:14:16 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:14:16 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:14:16 user nova-compute[71206]:   </os>
Jul 27 18:14:16 user nova-compute[71206]:   <features>
Jul 27 18:14:16 user nova-compute[71206]:     <acpi/>
Jul 27 18:14:16 user nova-compute[71206]:     <apic/>
Jul 27 18:14:16 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:14:16 user nova-compute[71206]:   </features>
Jul 27 18:14:16 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:14:16 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:14:16 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:14:16 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:14:16 user nova-compute[71206]:   </clock>
Jul 27 18:14:16 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:14:16 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:14:16 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:14:16 user nova-compute[71206]:   </cpu>
Jul 27 18:14:16 user nova-compute[71206]:   <devices>
Jul 27 18:14:16 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:14:16 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:14:16 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk"/>
Jul 27 18:14:16 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:14:16 user nova-compute[71206]:     </disk>
Jul 27 18:14:16 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:14:16 user nova-compute[71206]:       <mac address="fa:16:3e:ef:a8:16"/>
Jul 27 18:14:16 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:14:16 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:14:16 user nova-compute[71206]:       <target dev="tap2877a5ab-64"/>
Jul 27 18:14:16 user nova-compute[71206]:     </interface>
Jul 27 18:14:16 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:14:16 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/console.log" append="off"/>
Jul 27 18:14:16 user nova-compute[71206]:     </serial>
Jul 27 18:14:16 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:14:16 user nova-compute[71206]:     <video>
Jul 27 18:14:16 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:14:16 user nova-compute[71206]:     </video>
Jul 27 18:14:16 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:14:16 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:14:16 user nova-compute[71206]:     </rng>
Jul 27 18:14:16 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:14:16 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:14:16 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:14:16 user nova-compute[71206]:     </memballoon>
Jul 27 18:14:16 user nova-compute[71206]:   </devices>
Jul 27 18:14:16 user nova-compute[71206]: </domain>
Jul 27 18:14:16 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1353941570',display_name='tempest-AttachVolumeTestJSON-server-1353941570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1353941570',id=33,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7V+g+M6WeMwTiP2gIgDj/fYC3KrYFDaopxVkwDwFW8epcpD0OOsTjsLSOdLRULdp66gvkEcYy8312Kl+iYsJ14hP1yOAAWL+LpzbkSsHq5MojtxPpH6WH3JUKXc4p9vg==',key_name='tempest-keypair-2116423901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-fcihkavh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=e4e4ffe0-0c33-43b5-84bc-91fb7f63b019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG os_vif [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2877a5ab-64, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2877a5ab-64, col_values=(('external_ids', {'iface-id': '2877a5ab-6489-44f2-97ca-9ff3dcb3fad6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:a8:16', 'vm-uuid': 'e4e4ffe0-0c33-43b5-84bc-91fb7f63b019'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:16 user nova-compute[71206]: INFO os_vif [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64')
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No VIF found with MAC fa:16:3e:ef:a8:16, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updated VIF entry in instance network info cache for port 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating instance_info_cache with network_info: [{"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1afe2483-05b7-42ee-8036-d56e1c8be0bf req-b225d3c5-6c6d-4ea9-9249-e605c2fcb55c service nova] Releasing lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:17 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481642.163041, 29c8709b-3c27-4319-a213-b09ea02c8ef2 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:17 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] VM Stopped (Lifecycle Event)
Jul 27 18:14:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7bded38c-e27f-47c5-a178-0118129fc6f6 None None] [instance: 29c8709b-3c27-4319-a213-b09ea02c8ef2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:17 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481642.5769336, ccb00f08-4894-41f6-816f-2683b5e7315d => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:17 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] VM Stopped (Lifecycle Event)
Jul 27 18:14:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-950c0919-b02c-4424-9dda-6ed9fd5be65b None None] [instance: ccb00f08-4894-41f6-816f-2683b5e7315d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] No waiting events found dispatching network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:18 user nova-compute[71206]: WARNING nova.compute.manager [req-f2c50192-4489-4463-a37c-17032b0575c7 req-4f258bcf-32c8-4ae1-8544-ce5a249b541c service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received unexpected event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 for instance with vm_state building and task_state spawning.
Jul 27 18:14:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481660.0577052, e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] VM Resumed (Lifecycle Event)
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Instance spawned successfully.
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481660.0582619, e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] VM Started (Lifecycle Event)
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Took 5.95 seconds to spawn the instance on the hypervisor.
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] No waiting events found dispatching network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:20 user nova-compute[71206]: WARNING nova.compute.manager [req-36239068-357d-4224-a1a7-466b4c1c19e6 req-afb4dee2-ad9a-4979-88f7-169f6d71fb2f service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received unexpected event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 for instance with vm_state building and task_state spawning.
Jul 27 18:14:20 user nova-compute[71206]: INFO nova.compute.manager [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Took 6.66 seconds to build instance.
Jul 27 18:14:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8f47f481-39b2-4dae-aea7-0de86545c359 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.769s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:35 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:14:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:14:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.18804931640625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dcd7bf6-06d1-4399-904f-2ad23859c875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:14:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:39 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updating instance_info_cache with network_info: [{"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-33b47dd0-da00-45ae-baa5-7d54f8df84ab" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:14:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:48 user nova-compute[71206]: INFO nova.compute.manager [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Terminating instance
Jul 27 18:14:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-4deb0a2c-ddce-46bf-a15c-34e3e368d1d5 req-3209c9a5-4fc2-445f-bf27-462e62e213bd service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-unplugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Instance destroyed successfully.
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid 0dabbb68-9356-4fed-934e-1aaa4ab46a4f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-30620632',display_name='tempest-ServerRescueNegativeTestJSON-server-30620632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-30620632',id=24,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCi68c9oO92kRkhNtxabmjvRgJo4PFo88BPP1912YOJNpxv6kprwEW38bqoKHUS7lZ5RBh/UsMFWRhVeQnLE8jnJgxPhwiE+li26bPrj9IjhYuJoudkYoqP0kdcCUbBxA==',key_name='tempest-keypair-1854465445',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:10:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-4timr004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83503c246a474fb1b1591c82962b7a6c',uuid=0dabbb68-9356-4fed-934e-1aaa4ab46a4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "address": "fa:16:3e:ae:15:b3", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeeaca26-bc", "ovs_interfaceid": "aeeaca26-bc1b-472f-90b0-766855bf8ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG os_vif [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeeaca26-bc, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:14:49 user nova-compute[71206]: INFO os_vif [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:15:b3,bridge_name='br-int',has_traffic_filtering=True,id=aeeaca26-bc1b-472f-90b0-766855bf8ea2,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeeaca26-bc')
Jul 27 18:14:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Deleting instance files /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f_del
Jul 27 18:14:49 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Deletion of /opt/stack/data/nova/instances/0dabbb68-9356-4fed-934e-1aaa4ab46a4f_del complete
Jul 27 18:14:49 user nova-compute[71206]: INFO nova.compute.manager [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 18:14:49 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:14:49 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:50 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Took 0.86 seconds to deallocate network for instance.
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:50 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Deleted allocations for instance 0dabbb68-9356-4fed-934e-1aaa4ab46a4f
Jul 27 18:14:50 user nova-compute[71206]: INFO nova.compute.manager [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Unrescuing
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquired lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2ccde60c-d862-4f6f-b525-06ac2b5a6c56 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] Acquiring lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] Lock "0dabbb68-9356-4fed-934e-1aaa4ab46a4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] No waiting events found dispatching network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:50 user nova-compute[71206]: WARNING nova.compute.manager [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received unexpected event network-vif-plugged-aeeaca26-bc1b-472f-90b0-766855bf8ea2 for instance with vm_state deleted and task_state None.
Jul 27 18:14:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-7641626f-3be1-4ae1-9576-690a59b621d8 req-f50971f5-5f35-417e-92d0-c6217c460466 service nova] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Received event network-vif-deleted-aeeaca26-bc1b-472f-90b0-766855bf8ea2 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating instance_info_cache with network_info: [{"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Releasing lock "refresh_cache-31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'flavor' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:53 user nova-compute[71206]: WARNING nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:14:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:53 user nova-compute[71206]: WARNING nova.compute.manager [req-42cbbf76-3a4a-4931-8867-06b8c24f4bd2 req-875f5f98-76b4-4003-a2f6-15e871b0e536 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:14:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:53 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance destroyed successfully.
Jul 27 18:14:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:55 user nova-compute[71206]: DEBUG nova.compute.manager [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:55 user nova-compute[71206]: WARNING nova.compute.manager [req-59381025-b6c9-4544-8042-4740146ab0a6 req-0e7af08b-7a4c-45a6-8a03-285096268d10 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:14:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:14:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:14:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:14:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:14:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:14:57 user nova-compute[71206]: WARNING nova.compute.manager [req-46b850be-7ab1-4a81-87f5-10a3b0f911af req-50e40278-5602-45ee-b125-0498d9424067 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state rescued and task_state unrescuing.
Jul 27 18:14:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:14:57 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481697.9791794, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:57 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Resumed (Lifecycle Event)
Jul 27 18:14:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e1531359-bd28-4e2b-9029-a167b3fb852d tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:58 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 18:14:58 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481697.980202, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:14:58 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Started (Lifecycle Event)
Jul 27 18:14:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:14:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:14:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:14:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481689.3918722, 0dabbb68-9356-4fed-934e-1aaa4ab46a4f => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:15:04 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] VM Stopped (Lifecycle Event)
Jul 27 18:15:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f458af76-16c8-470c-8693-91a6dd910c2a None None] [instance: 0dabbb68-9356-4fed-934e-1aaa4ab46a4f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:15:05 user nova-compute[71206]: INFO nova.compute.claims [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Claim successful on node user
Jul 27 18:15:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:15:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:15:05 user nova-compute[71206]: INFO nova.virt.block_device [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Booting with volume b1d44431-378c-4764-8a05-5290f14c5369 at /dev/vda
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.utils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2677d2a-751e-495e-950d-75a56ecb5605]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7719d-cb16-4250-ad09-cd75c5e139df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9737d8bf-23ee-4d11-af21-52874ac19951]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb68f48-4630-48a0-91a2-ed91c0eb1e79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:15:05 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:15:05 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea4cd6-a76b-461e-9c15-926e68d77a56]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG os_brick.utils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:15:05 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating existing volume attachment record: 8cd26291-17af-49c9-9ba0-d58eec5db088 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:15:06 user nova-compute[71206]: DEBUG nova.policy [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:15:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Successfully created port: 65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:15:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Successfully updated port: 65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-changed-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Refreshing instance network info cache due to event network-changed-65d7e78e-fc96-41e3-9550-730f0f96107a. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:15:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] Acquiring lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.network.neutron [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating instance_info_cache with network_info: [{"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Instance network_info: |[{"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] Acquired lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Refreshing network info cache for port 65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updated VIF entry in instance network info cache for port 65d7e78e-fc96-41e3-9550-730f0f96107a. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating instance_info_cache with network_info: [{"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:15:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b9de02b-321c-4c7e-a7b5-99591fae193c req-340272c2-a0db-4f97-b85e-de609df1c955 service nova] Releasing lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:15:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:14 user nova-compute[71206]: INFO nova.compute.manager [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Detaching volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:15:14 user nova-compute[71206]: INFO nova.virt.block_device [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Attempting to driver detach volume cced6d53-0210-46a0-82f4-f2bea4bbb2ac from mountpoint /dev/vdb
Jul 27 18:15:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Attempting to detach device vdb from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:15:14 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:15:14 user nova-compute[71206]:   <source dev="/dev/sdh"/>
Jul 27 18:15:14 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:15:14 user nova-compute[71206]:   <serial>cced6d53-0210-46a0-82f4-f2bea4bbb2ac</serial>
Jul 27 18:15:14 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:15:14 user nova-compute[71206]: </disk>
Jul 27 18:15:14 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:15:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully detached device vdb from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the persistent domain config.
Jul 27 18:15:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:15:14 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:15:14 user nova-compute[71206]:   <source dev="/dev/sdh"/>
Jul 27 18:15:14 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:15:14 user nova-compute[71206]:   <serial>cced6d53-0210-46a0-82f4-f2bea4bbb2ac</serial>
Jul 27 18:15:14 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:15:14 user nova-compute[71206]: </disk>
Jul 27 18:15:14 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:15:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481715.1636355, d4764a2f-d9e3-40e9-933f-29374922e420 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:15:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully detached device vdb from instance d4764a2f-d9e3-40e9-933f-29374922e420 from the live domain config.
Jul 27 18:15:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpHJEDQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:15:15 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[684155b4-1439-46b3-8110-f19d8d802eb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:15:15 user nova-compute[71206]: No targets found.
Jul 27 18:15:15 user nova-compute[71206]: iSNS:
Jul 27 18:15:15 user nova-compute[71206]: No targets found.
Jul 27 18:15:15 user nova-compute[71206]: STATIC:
Jul 27 18:15:15 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:15:15 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:15:15 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:15:15 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac
Jul 27 18:15:15 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:15:15 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:15:15 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:15:15 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:15:15 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:15:15 user nova-compute[71206]: FIRMWARE:
Jul 27 18:15:15 user nova-compute[71206]: No targets found.
Jul 27 18:15:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:15:15 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:15:15 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e218c-e56f-4597-b4b1-f96d0c04fa44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f47e5b-0ec9-4216-aae0-70349361ecde]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:15 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:15:15 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:15 user nova-compute[71206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac (non-flash)
Jul 27 18:15:15 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c2209d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac'): ({'sdh'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Removing single pathed devices sdh {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbe21f-79b1-44cc-b502-e6b1f5a77f5e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a61d0-723c-4668-9ed2-e8be62589e3d]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flushing IO for device /dev/sdh {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7399a54-5723-4b62-8f44-f1ed89eaba30]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc458ea8-e99f-4c8b-a289-8fd8a1eb2d15]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] SCSI volumes sdh have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[343062e3-3ee2-4195-abfd-07215b4757f0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e192e-e094-4fc0-bb02-ddd7485c4c40]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260]
Jul 27 18:15:15 user nova-compute[71206]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac, portal: 172.16.0.220,3260] successful.
Jul 27 18:15:15 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced6d53-0210-46a0-82f4-f2bea4bbb2ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2e622-17a7-409c-bfcf-73140066bdbf]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== disconnect_volume: return (318ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:15:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:15:16 user nova-compute[71206]: DEBUG nova.objects.instance [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'flavor' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:15:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-71e9a600-3c88-476c-b089-4700c3eda9b0 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:15:18 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Creating image(s)
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Ensure instance console log exists: /opt/stack/data/nova/instances/4f90e5e6-a1f2-4181-bf15-b91a56a225b2/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Start _get_guest_xml network_info=[{"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '8cd26291-17af-49c9-9ba0-d58eec5db088', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f90e5e6-a1f2-4181-bf15-b91a56a225b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1d44431-378c-4764-8a05-5290f14c5369', 'serial': 'b1d44431-378c-4764-8a05-5290f14c5369'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:15:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:18 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:15:18 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:15:18 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:15:18 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b639b-66a5-48bb-90f4-223c2b78be5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:15:18 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d2a54-76a5-4c54-90ef-edb204d895f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369] added
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7744e3-c1e4-4d98-906d-9298972dff3c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b05094-826e-4ad0-82f2-9f4686fbcff1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxqVfcLE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxqVfcLE" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6054d-0d57-41f9-8746-cbb230c991f7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IxqVfcLE'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad258e5d-8f23-4447-b9bf-4c9cffd6f89a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf1efd-a530-47b7-a221-d17a74b034c4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0bef2-61eb-47b7-a9ce-36032b4215e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]
Jul 27 18:15:18 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085f52e-75e2-4c67-83d6-cac30981590a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf2409-419a-4738-8672-0c69369b7159]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:15:18 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:15:18 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6d408-a7bb-481a-99da-ce1af197da10]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:15:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23130313531666634', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313531666634', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208592566',display_name='tempest-TestVolumeBootPattern-server-208592566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208592566',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-9cco7xqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:15:06Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=4f90e5e6-a1f2-4181-bf15-b91a56a225b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:15:19 user nova-compute[71206]:   <uuid>4f90e5e6-a1f2-4181-bf15-b91a56a225b2</uuid>
Jul 27 18:15:19 user nova-compute[71206]:   <name>instance-00000022</name>
Jul 27 18:15:19 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:15:19 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:15:19 user nova-compute[71206]:   <metadata>
Jul 27 18:15:19 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:15:19 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:15:19 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-server-208592566</nova:name>
Jul 27 18:15:19 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:15:18</nova:creationTime>
Jul 27 18:15:19 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:15:19 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:15:19 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:15:19 user nova-compute[71206]:       <nova:owner>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:15:19 user nova-compute[71206]:       </nova:owner>
Jul 27 18:15:19 user nova-compute[71206]:       <nova:ports>
Jul 27 18:15:19 user nova-compute[71206]:         <nova:port uuid="65d7e78e-fc96-41e3-9550-730f0f96107a">
Jul 27 18:15:19 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:15:19 user nova-compute[71206]:         </nova:port>
Jul 27 18:15:19 user nova-compute[71206]:       </nova:ports>
Jul 27 18:15:19 user nova-compute[71206]:     </nova:instance>
Jul 27 18:15:19 user nova-compute[71206]:   </metadata>
Jul 27 18:15:19 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:15:19 user nova-compute[71206]:     <system>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="serial">4f90e5e6-a1f2-4181-bf15-b91a56a225b2</entry>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="uuid">4f90e5e6-a1f2-4181-bf15-b91a56a225b2</entry>
Jul 27 18:15:19 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:15:19 user nova-compute[71206]:     </system>
Jul 27 18:15:19 user nova-compute[71206]:   </sysinfo>
Jul 27 18:15:19 user nova-compute[71206]:   <os>
Jul 27 18:15:19 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:15:19 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:15:19 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:15:19 user nova-compute[71206]:   </os>
Jul 27 18:15:19 user nova-compute[71206]:   <features>
Jul 27 18:15:19 user nova-compute[71206]:     <acpi/>
Jul 27 18:15:19 user nova-compute[71206]:     <apic/>
Jul 27 18:15:19 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:15:19 user nova-compute[71206]:   </features>
Jul 27 18:15:19 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:15:19 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:15:19 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:15:19 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:15:19 user nova-compute[71206]:   </clock>
Jul 27 18:15:19 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:15:19 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:15:19 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:15:19 user nova-compute[71206]:   </cpu>
Jul 27 18:15:19 user nova-compute[71206]:   <devices>
Jul 27 18:15:19 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:15:19 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:15:19 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:15:19 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:15:19 user nova-compute[71206]:       <serial>b1d44431-378c-4764-8a05-5290f14c5369</serial>
Jul 27 18:15:19 user nova-compute[71206]:     </disk>
Jul 27 18:15:19 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:15:19 user nova-compute[71206]:       <mac address="fa:16:3e:73:0d:95"/>
Jul 27 18:15:19 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:15:19 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:15:19 user nova-compute[71206]:       <target dev="tap65d7e78e-fc"/>
Jul 27 18:15:19 user nova-compute[71206]:     </interface>
Jul 27 18:15:19 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:15:19 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/4f90e5e6-a1f2-4181-bf15-b91a56a225b2/console.log" append="off"/>
Jul 27 18:15:19 user nova-compute[71206]:     </serial>
Jul 27 18:15:19 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:15:19 user nova-compute[71206]:     <video>
Jul 27 18:15:19 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:15:19 user nova-compute[71206]:     </video>
Jul 27 18:15:19 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:15:19 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:15:19 user nova-compute[71206]:     </rng>
Jul 27 18:15:19 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:15:19 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:15:19 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:15:19 user nova-compute[71206]:     </memballoon>
Jul 27 18:15:19 user nova-compute[71206]:   </devices>
Jul 27 18:15:19 user nova-compute[71206]: </domain>
Jul 27 18:15:19 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208592566',display_name='tempest-TestVolumeBootPattern-server-208592566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208592566',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-9cco7xqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:15:06Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=4f90e5e6-a1f2-4181-bf15-b91a56a225b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG os_vif [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d7e78e-fc, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65d7e78e-fc, col_values=(('external_ids', {'iface-id': '65d7e78e-fc96-41e3-9550-730f0f96107a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:0d:95', 'vm-uuid': '4f90e5e6-a1f2-4181-bf15-b91a56a225b2'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:19 user nova-compute[71206]: INFO os_vif [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc')
Jul 27 18:15:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:15:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:73:0d:95, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] No waiting events found dispatching network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:21 user nova-compute[71206]: WARNING nova.compute.manager [req-126f7758-8368-4357-9a8c-1533ff6ab06a req-267d311c-902a-4567-a8fc-12492389b772 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received unexpected event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a for instance with vm_state building and task_state spawning.
Jul 27 18:15:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] No waiting events found dispatching network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:23 user nova-compute[71206]: WARNING nova.compute.manager [req-146466d6-1375-4629-824b-9c5eef906d8d req-63356635-7399-447d-88c8-e99072374a04 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received unexpected event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a for instance with vm_state building and task_state spawning.
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481723.750156, 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] VM Resumed (Lifecycle Event)
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Instance spawned successfully.
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481723.7512677, 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] VM Started (Lifecycle Event)
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Took 5.42 seconds to spawn the instance on the hypervisor.
Jul 27 18:15:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:15:23 user nova-compute[71206]: INFO nova.compute.manager [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Took 19.02 seconds to build instance.
Jul 27 18:15:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d7af22d-92c8-4e22-b74c-cc615ca7a3be tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.130s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:32 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:15:38 user nova-compute[71206]: INFO nova.compute.claims [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Claim successful on node user
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:15:39 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:39 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=25.19985580444336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.564s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.454s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:15:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0dcd7bf6-06d1-4399-904f-2ad23859c875 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.policy [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '450fa830059c43e79f2cf7ca9d209d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6fa83a744c1976f04ce4c03e159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:15:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Creating image(s)
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "/opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "/opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "/opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.160s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk 1073741824" returned: 0 in 0.056s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.792s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Cannot resize image /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'migration_context' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Ensure instance console log exists: /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Successfully created port: 03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Successfully updated port: 03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing instance network info cache due to event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Instance network_info: |[{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.neutron [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Start _get_guest_xml network_info=[{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:15:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-444180577',display_name='tempest-TestStampPattern-server-444180577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444180577',id=35,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-nydvtnv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:15:41Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=74f56d44-bada-4942-b47d-a0312ce2dc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'pci_devices' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:15:42 user nova-compute[71206]:   <uuid>74f56d44-bada-4942-b47d-a0312ce2dc97</uuid>
Jul 27 18:15:42 user nova-compute[71206]:   <name>instance-00000023</name>
Jul 27 18:15:42 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:15:42 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:15:42 user nova-compute[71206]:   <metadata>
Jul 27 18:15:42 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:15:42 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:name>tempest-TestStampPattern-server-444180577</nova:name>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:15:42</nova:creationTime>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:15:42 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:15:42 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:owner>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:user uuid="450fa830059c43e79f2cf7ca9d209d76">tempest-TestStampPattern-685676605-project-member</nova:user>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:project uuid="090bd6fa83a744c1976f04ce4c03e159">tempest-TestStampPattern-685676605</nova:project>
Jul 27 18:15:42 user nova-compute[71206]:       </nova:owner>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:15:42 user nova-compute[71206]:       <nova:ports>
Jul 27 18:15:42 user nova-compute[71206]:         <nova:port uuid="03a1ad66-5f66-4ede-82ea-05805901e268">
Jul 27 18:15:42 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 18:15:42 user nova-compute[71206]:         </nova:port>
Jul 27 18:15:42 user nova-compute[71206]:       </nova:ports>
Jul 27 18:15:42 user nova-compute[71206]:     </nova:instance>
Jul 27 18:15:42 user nova-compute[71206]:   </metadata>
Jul 27 18:15:42 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:15:42 user nova-compute[71206]:     <system>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="serial">74f56d44-bada-4942-b47d-a0312ce2dc97</entry>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="uuid">74f56d44-bada-4942-b47d-a0312ce2dc97</entry>
Jul 27 18:15:42 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:15:42 user nova-compute[71206]:     </system>
Jul 27 18:15:42 user nova-compute[71206]:   </sysinfo>
Jul 27 18:15:42 user nova-compute[71206]:   <os>
Jul 27 18:15:42 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:15:42 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:15:42 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:15:42 user nova-compute[71206]:   </os>
Jul 27 18:15:42 user nova-compute[71206]:   <features>
Jul 27 18:15:42 user nova-compute[71206]:     <acpi/>
Jul 27 18:15:42 user nova-compute[71206]:     <apic/>
Jul 27 18:15:42 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:15:42 user nova-compute[71206]:   </features>
Jul 27 18:15:42 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:15:42 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:15:42 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:15:42 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:15:42 user nova-compute[71206]:   </clock>
Jul 27 18:15:42 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:15:42 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:15:42 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:15:42 user nova-compute[71206]:   </cpu>
Jul 27 18:15:42 user nova-compute[71206]:   <devices>
Jul 27 18:15:42 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:15:42 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:15:42 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk"/>
Jul 27 18:15:42 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:15:42 user nova-compute[71206]:     </disk>
Jul 27 18:15:42 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:15:42 user nova-compute[71206]:       <mac address="fa:16:3e:d3:f0:a2"/>
Jul 27 18:15:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:15:42 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:15:42 user nova-compute[71206]:       <target dev="tap03a1ad66-5f"/>
Jul 27 18:15:42 user nova-compute[71206]:     </interface>
Jul 27 18:15:42 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:15:42 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/console.log" append="off"/>
Jul 27 18:15:42 user nova-compute[71206]:     </serial>
Jul 27 18:15:42 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:15:42 user nova-compute[71206]:     <video>
Jul 27 18:15:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:15:42 user nova-compute[71206]:     </video>
Jul 27 18:15:42 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:15:42 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:15:42 user nova-compute[71206]:     </rng>
Jul 27 18:15:42 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:15:42 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:15:42 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:15:42 user nova-compute[71206]:     </memballoon>
Jul 27 18:15:42 user nova-compute[71206]:   </devices>
Jul 27 18:15:42 user nova-compute[71206]: </domain>
Jul 27 18:15:42 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-444180577',display_name='tempest-TestStampPattern-server-444180577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444180577',id=35,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-nydvtnv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:15:41Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=74f56d44-bada-4942-b47d-a0312ce2dc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG os_vif [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03a1ad66-5f, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03a1ad66-5f, col_values=(('external_ids', {'iface-id': '03a1ad66-5f66-4ede-82ea-05805901e268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:f0:a2', 'vm-uuid': '74f56d44-bada-4942-b47d-a0312ce2dc97'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:42 user nova-compute[71206]: INFO os_vif [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f')
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:15:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No VIF found with MAC fa:16:3e:d3:f0:a2, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:15:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updated VIF entry in instance network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:15:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:15:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-864c25a9-c204-4eaf-9446-1e14cab62850 req-b7be0039-b72b-43f7-8914-c7467fdbe04c service nova] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] No waiting events found dispatching network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:44 user nova-compute[71206]: WARNING nova.compute.manager [req-f7ad0e89-1d08-49cb-8573-1f15f59458d4 req-8690c69c-17c1-4a84-8d5c-6a2683289e6f service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received unexpected event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 for instance with vm_state building and task_state spawning.
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481746.3785703, 74f56d44-bada-4942-b47d-a0312ce2dc97 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] VM Resumed (Lifecycle Event)
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Instance spawned successfully.
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] No waiting events found dispatching network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:46 user nova-compute[71206]: WARNING nova.compute.manager [req-8350b639-2d6d-4956-8bab-b084febac85e req-2c5f032a-7d30-482e-be8e-f3adec208aeb service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received unexpected event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 for instance with vm_state building and task_state spawning.
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481746.380747, 74f56d44-bada-4942-b47d-a0312ce2dc97 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] VM Started (Lifecycle Event)
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Took 5.90 seconds to spawn the instance on the hypervisor.
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:15:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:15:46 user nova-compute[71206]: INFO nova.compute.manager [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Took 8.18 seconds to build instance.
Jul 27 18:15:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4601ef99-df76-4dfd-a831-c2ce5fb417b8 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.721s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:51 user nova-compute[71206]: INFO nova.compute.manager [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Terminating instance
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-baf37067-501b-4d42-b2a5-4107355ea6dc req-7c2dc079-8a3c-46f3-b6aa-06dee173577b service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-unplugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Instance destroyed successfully.
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid f4daa5a7-ada3-4d66-a84b-ac02d78220a9 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1086757011',display_name='tempest-ServerRescueNegativeTestJSON-server-1086757011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1086757011',id=8,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-g2cpq40t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:01:37Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=f4daa5a7-ada3-4d66-a84b-ac02d78220a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:15:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "address": "fa:16:3e:fc:53:81", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4167e460-cb", "ovs_interfaceid": "4167e460-cbf2-4ff6-b173-a5318f5e3b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG os_vif [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4167e460-cb, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:15:52 user nova-compute[71206]: INFO os_vif [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:53:81,bridge_name='br-int',has_traffic_filtering=True,id=4167e460-cbf2-4ff6-b173-a5318f5e3b6c,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4167e460-cb')
Jul 27 18:15:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Deleting instance files /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9_del
Jul 27 18:15:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Deletion of /opt/stack/data/nova/instances/f4daa5a7-ada3-4d66-a84b-ac02d78220a9_del complete
Jul 27 18:15:52 user nova-compute[71206]: INFO nova.compute.manager [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 18:15:52 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:15:52 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Took 0.54 seconds to deallocate network for instance.
Jul 27 18:15:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:53 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Deleted allocations for instance f4daa5a7-ada3-4d66-a84b-ac02d78220a9
Jul 27 18:15:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1b350030-5896-46bd-9a69-6c4b8718aaf9 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] Acquiring lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] Lock "f4daa5a7-ada3-4d66-a84b-ac02d78220a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] No waiting events found dispatching network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:15:53 user nova-compute[71206]: WARNING nova.compute.manager [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received unexpected event network-vif-plugged-4167e460-cbf2-4ff6-b173-a5318f5e3b6c for instance with vm_state deleted and task_state None.
Jul 27 18:15:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-8dcf864a-f7f0-40d0-81f0-7b6516dff33e req-9628b949-3ab5-41db-9dd9-2ec1c77cbef3 service nova] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Received event network-vif-deleted-4167e460-cbf2-4ff6-b173-a5318f5e3b6c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:15:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 33b47dd0-da00-45ae-baa5-7d54f8df84ab {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 0dcd7bf6-06d1-4399-904f-2ad23859c875 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7824a157-7697-4e8a-a212-201cf29cb062" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "7824a157-7697-4e8a-a212-201cf29cb062" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:15:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-changed-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Refreshing instance network info cache due to event network-changed-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] Acquiring lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] Acquired lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Refreshing network info cache for port 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updated VIF entry in instance network info cache for port 2877a5ab-6489-44f2-97ca-9ff3dcb3fad6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating instance_info_cache with network_info: [{"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e04a4c62-5795-46dc-a82b-5a7f215c48f2 req-32751d55-67fd-42c9-b926-ee5e12366336 service nova] Releasing lock "refresh_cache-e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:06 user nova-compute[71206]: INFO nova.compute.manager [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Terminating instance
Jul 27 18:16:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:06 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481751.9796717, f4daa5a7-ada3-4d66-a84b-ac02d78220a9 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:06 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] VM Stopped (Lifecycle Event)
Jul 27 18:16:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9d0c723c-a9cb-469b-b913-5dfd4c84ae03 None None] [instance: f4daa5a7-ada3-4d66-a84b-ac02d78220a9] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-unplugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] No waiting events found dispatching network-vif-unplugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-34f3a22a-1a76-4b19-aba7-c72089f3cb73 req-c05a905a-9b66-4da6-9dcf-1fcbf6dbe00a service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-unplugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:16:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Instance destroyed successfully.
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lazy-loading 'resources' on Instance uuid 0dcd7bf6-06d1-4399-904f-2ad23859c875 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2006759328',display_name='tempest-VolumesActionsTest-instance-2006759328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2006759328',id=32,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:14:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d79cab68c291407eb98ea332f5d2c243',ramdisk_id='',reservation_id='r-12gucrlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1689587246',owner_user_name='tempest-VolumesActionsTest-1689587246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:14:13Z,user_data=None,user_id='dcff4a7fea7242f7b2c98f14dc24c116',uuid=0dcd7bf6-06d1-4399-904f-2ad23859c875,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converting VIF {"id": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "address": "fa:16:3e:2d:02:0b", "network": {"id": "7b109903-01a0-43bf-a86c-cf76e830e910", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1775551584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d79cab68c291407eb98ea332f5d2c243", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7bc56e-f8", "ovs_interfaceid": "ce7bc56e-f8f6-49a4-ab27-fc320ebf658c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG os_vif [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce7bc56e-f8, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:07 user nova-compute[71206]: INFO os_vif [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c,network=Network(7b109903-01a0-43bf-a86c-cf76e830e910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7bc56e-f8')
Jul 27 18:16:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Deleting instance files /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875_del
Jul 27 18:16:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Deletion of /opt/stack/data/nova/instances/0dcd7bf6-06d1-4399-904f-2ad23859c875_del complete
Jul 27 18:16:07 user nova-compute[71206]: INFO nova.compute.manager [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 27 18:16:07 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:16:07 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-e157772d-e0b2-4aba-b1f3-98e3ba775ed9 req-63cac41a-0033-40a9-ad57-34f322b7a3b0 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-deleted-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:08 user nova-compute[71206]: INFO nova.compute.manager [req-e157772d-e0b2-4aba-b1f3-98e3ba775ed9 req-63cac41a-0033-40a9-ad57-34f322b7a3b0 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Neutron deleted interface ce7bc56e-f8f6-49a4-ab27-fc320ebf658c; detaching it from the instance and deleting it from the info cache
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-e157772d-e0b2-4aba-b1f3-98e3ba775ed9 req-63cac41a-0033-40a9-ad57-34f322b7a3b0 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:08 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Took 0.56 seconds to deallocate network for instance.
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-e157772d-e0b2-4aba-b1f3-98e3ba775ed9 req-63cac41a-0033-40a9-ad57-34f322b7a3b0 service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Detach interface failed, port_id=ce7bc56e-f8f6-49a4-ab27-fc320ebf658c, reason: Instance 0dcd7bf6-06d1-4399-904f-2ad23859c875 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:08 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Deleted allocations for instance 0dcd7bf6-06d1-4399-904f-2ad23859c875
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2aff1860-0804-4ad8-b3df-14028ce12980 tempest-VolumesActionsTest-1689587246 tempest-VolumesActionsTest-1689587246-project-member] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:09 user nova-compute[71206]: INFO nova.compute.manager [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attaching volume eaff39f2-a8f8-4680-930b-0f21cd6721d8 to /dev/vdb
Jul 27 18:16:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] Acquiring lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] Lock "0dcd7bf6-06d1-4399-904f-2ad23859c875-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] No waiting events found dispatching network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:09 user nova-compute[71206]: WARNING nova.compute.manager [req-85475ab8-43ac-4d8c-9f98-c70da2001c9e req-ded1da5d-1bff-47da-845e-8516da5db95d service nova] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Received unexpected event network-vif-plugged-ce7bc56e-f8f6-49a4-ab27-fc320ebf658c for instance with vm_state deleted and task_state None.
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.utils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a569c4e-1a34-49cb-980c-471841853f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b7710-a2c4-40d4-ab33-fa41af841eab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d246c8af-aa3d-41fc-a8c5-478f59483ea1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca7d54-f415-4594-bc93-17682ece0658]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:16:09 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:16:09 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc8256-ac96-4ac7-998b-1be6f363f64f]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG os_brick.utils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:09 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating existing volume attachment record: a85385ea-2137-4a6e-8417-796bdca9bd52 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:16:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXJtNVOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:16 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:16 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:16 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de34f1-5192-4993-b02b-1371efdf7d0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:16:16 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb141b2-cac6-426d-a866-84c81c91b498]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8] added
Jul 27 18:16:16 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b234d4-993c-40db-b8be-6288e7098fe4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810ac84-8ecf-4132-a0d9-697a49ed9cb0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXJtNVOa {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXJtNVOa" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a11370-0e98-4898-9795-771e24cb4ace]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXJtNVOa'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2f585-0dd3-4bfc-9f04-4f821889af02]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[daebf046-0d73-4efe-9a8f-8ac3f5a27047]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d0ef2-05d0-4aa3-a289-bc865f1fce55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260]
Jul 27 18:16:17 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260] successful.
Jul 27 18:16:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf24cae-0336-4208-aa0a-5046b6939a43]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b0b158-c922-46dd-8b63-6c4406bce49c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:17 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:17 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915d324-cccc-4a39-8ec8-1f56f9786200]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:16:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXJtNVOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23038656438326332', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038656438326332', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.objects.instance [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:16:18 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:18 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:16:18 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:16:18 user nova-compute[71206]:   <serial>eaff39f2-a8f8-4680-930b-0f21cd6721d8</serial>
Jul 27 18:16:18 user nova-compute[71206]: </disk>
Jul 27 18:16:18 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No VIF found with MAC fa:16:3e:ef:a8:16, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:16:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb3b4f0e-d64c-4298-8416-2b1c83373d8f tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.668s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:22 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481767.4116852, 0dcd7bf6-06d1-4399-904f-2ad23859c875 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:22 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] VM Stopped (Lifecycle Event)
Jul 27 18:16:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e1132662-b899-45f9-a508-f13a4833a50b None None] [instance: 0dcd7bf6-06d1-4399-904f-2ad23859c875] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:23 user nova-compute[71206]: INFO nova.compute.manager [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attaching volume 068e2c9c-2fed-4ea5-9bae-8e769b4f5296 to /dev/vdc
Jul 27 18:16:23 user nova-compute[71206]: DEBUG os_brick.utils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f8b5b-c62c-46d1-a48c-c8b25a6cda97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75f3df-3218-49a9-a090-341ca7cc0652]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d04bd5-65dc-457f-b355-133a568461a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d89122-2d40-4493-a8cb-65545039011b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:16:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:16:24 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:16:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd9d9e-bde3-4d47-9291-50b06fa89fa8]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating existing volume attachment record: 8f019579-1e30-464c-8f7a-0e97d885d004 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:16:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEjFYhJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:31 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:31 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:31 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e403176f-202a-41f4-b2da-66d6a1bd57a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:16:31 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d887aa72-29d4-4a48-87ee-54b2d6a13565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296] added
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7718f19-b6a3-4c60-af94-d20c5c5fcbcf]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd2c8b-fcab-4365-9e4e-5f18bef36ed6]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEjFYhJH {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEjFYhJH" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40cdaf-4109-4165-9046-2d42068af832]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SEjFYhJH'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5aaa9-d7d0-4b16-a66d-33c716360523]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[208631a4-1fed-466f-abbd-1cbb6c1a2bfc]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd465d65-9d84-412b-a6b0-271668cda057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260]
Jul 27 18:16:31 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260] successful.
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4da06-a467-45f1-8482-0b448beed60e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8645a0-3fb6-40ce-a05c-b091eec9e701]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:31 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:31 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c6610-6c49-44bc-ab31-d049835b3930]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:31 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEjFYhJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23263626634363531', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263626634363531', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG nova.objects.instance [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:16:32 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:32 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:16:32 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:16:32 user nova-compute[71206]:   <serial>068e2c9c-2fed-4ea5-9bae-8e769b4f5296</serial>
Jul 27 18:16:32 user nova-compute[71206]: </disk>
Jul 27 18:16:32 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:16:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] No VIF found with MAC fa:16:3e:ef:a8:16, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:16:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27d3b789-837c-4984-8131-acd96c15f19c tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.479s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:34 user nova-compute[71206]: INFO nova.compute.manager [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Detaching volume eaff39f2-a8f8-4680-930b-0f21cd6721d8
Jul 27 18:16:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:34 user nova-compute[71206]: INFO nova.virt.block_device [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attempting to driver detach volume eaff39f2-a8f8-4680-930b-0f21cd6721d8 from mountpoint /dev/vdb
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Attempting to detach device vdb from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:16:34 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:34 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:16:34 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:16:34 user nova-compute[71206]:   <serial>eaff39f2-a8f8-4680-930b-0f21cd6721d8</serial>
Jul 27 18:16:34 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:16:34 user nova-compute[71206]: </disk>
Jul 27 18:16:34 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:16:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdb from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the persistent domain config.
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:16:34 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:34 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:16:34 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:16:34 user nova-compute[71206]:   <serial>eaff39f2-a8f8-4680-930b-0f21cd6721d8</serial>
Jul 27 18:16:34 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:16:34 user nova-compute[71206]: </disk>
Jul 27 18:16:34 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481794.6433265, e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:16:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdb from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the live domain config.
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXJtNVOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:34 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f991af-b632-4462-8e5e-b43d7e9f7451]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:16:34 user nova-compute[71206]: No targets found.
Jul 27 18:16:34 user nova-compute[71206]: iSNS:
Jul 27 18:16:34 user nova-compute[71206]: No targets found.
Jul 27 18:16:34 user nova-compute[71206]: STATIC:
Jul 27 18:16:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:16:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:16:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:16:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8
Jul 27 18:16:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:34 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296
Jul 27 18:16:34 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:34 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:34 user nova-compute[71206]: FIRMWARE:
Jul 27 18:16:34 user nova-compute[71206]: No targets found.
Jul 27 18:16:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:16:34 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:16:34 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e441f-83e6-4202-8016-302ac8994d82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6589eb8-0a7d-4e6d-9fdb-92c00518af44]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:34 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c7db5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70d67d-89fe-47dc-9922-08c186f3c355]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb508317-8b06-4779-a16c-546fb1c0fb3d]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d485360-1ee7-431f-882a-eb130ba97af7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69734ae-bdba-411e-9f0a-aea1c59a1905]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b588db-f1b9-4c48-b8d1-000ccd496496]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4b617-6918-48b2-8308-a08dd688667b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260]
Jul 27 18:16:34 user nova-compute[71206]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8, portal: 172.16.0.220,3260] successful.
Jul 27 18:16:34 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaff39f2-a8f8-4680-930b-0f21cd6721d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe04965-85e1-4879-8421-04fe2e8088bb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== disconnect_volume: return (308ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:16:35 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:16:35 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9751fb32-e76b-4a1a-a020-a2374a2dbe7b tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:36 user nova-compute[71206]: INFO nova.compute.manager [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Detaching volume 068e2c9c-2fed-4ea5-9bae-8e769b4f5296
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:36 user nova-compute[71206]: INFO nova.virt.block_device [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Attempting to driver detach volume 068e2c9c-2fed-4ea5-9bae-8e769b4f5296 from mountpoint /dev/vdc
Jul 27 18:16:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Attempting to detach device vdc from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:16:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:16:36 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:36 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:16:36 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:16:36 user nova-compute[71206]:   <serial>068e2c9c-2fed-4ea5-9bae-8e769b4f5296</serial>
Jul 27 18:16:36 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:16:36 user nova-compute[71206]: </disk>
Jul 27 18:16:36 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:16:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdc from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the persistent domain config.
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:16:37 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:16:37 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:16:37 user nova-compute[71206]:   <target dev="vdc" bus="virtio"/>
Jul 27 18:16:37 user nova-compute[71206]:   <serial>068e2c9c-2fed-4ea5-9bae-8e769b4f5296</serial>
Jul 27 18:16:37 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 18:16:37 user nova-compute[71206]: </disk>
Jul 27 18:16:37 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481797.5068145, e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:16:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully detached device vdc from instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 from the live domain config.
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEjFYhJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:37 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec72b4-08ce-44d1-b8e7-b99c1b592df8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:16:37 user nova-compute[71206]: No targets found.
Jul 27 18:16:37 user nova-compute[71206]: iSNS:
Jul 27 18:16:37 user nova-compute[71206]: No targets found.
Jul 27 18:16:37 user nova-compute[71206]: STATIC:
Jul 27 18:16:37 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:16:37 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:37 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:37 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:16:37 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:37 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:37 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:16:37 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:37 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:37 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296
Jul 27 18:16:37 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:37 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:37 user nova-compute[71206]: FIRMWARE:
Jul 27 18:16:37 user nova-compute[71206]: No targets found.
Jul 27 18:16:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:16:37 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:16:37 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b378f-4d3b-4a30-9c48-9ae686394aa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[87446a2c-5439-48d5-a5cf-2ec82d3f4275]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 (non-flash)
Jul 27 18:16:37 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e32936ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a338df-521c-44a9-a6c4-de4b1d624fb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390bfc5-e9b7-4ab2-a56c-cdd764f9481e]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53631205-8a2a-4d66-8c64-5ad54d998639]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a98485-a375-4a68-aa9a-25ccc83b72b1]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8a761-48eb-41bc-b4c0-d3d6d7891688]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a2e4e-1146-4dd2-9cba-cac905702d8c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260]
Jul 27 18:16:37 user nova-compute[71206]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296, portal: 172.16.0.220,3260] successful.
Jul 27 18:16:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:068e2c9c-2fed-4ea5-9bae-8e769b4f5296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43095f0e-efde-431f-917b-3326799a8f8f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] <== disconnect_volume: return (448ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'flavor' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:16:38 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:16:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.214759826660156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e5db9f50-17be-4855-9c90-94bdcb87f262 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.094s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7824a157-7697-4e8a-a212-201cf29cb062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:39 user nova-compute[71206]: INFO nova.compute.manager [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Terminating instance
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-unplugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] No waiting events found dispatching network-vif-unplugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-c8234363-09ee-4d13-ab94-fb8b3aafb2bc req-eb56f026-3087-47b3-b5fa-618a35d0a410 service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-unplugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:16:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Instance destroyed successfully.
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lazy-loading 'resources' on Instance uuid e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:14:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1353941570',display_name='tempest-AttachVolumeTestJSON-server-1353941570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1353941570',id=33,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7V+g+M6WeMwTiP2gIgDj/fYC3KrYFDaopxVkwDwFW8epcpD0OOsTjsLSOdLRULdp66gvkEcYy8312Kl+iYsJ14hP1yOAAWL+LpzbkSsHq5MojtxPpH6WH3JUKXc4p9vg==',key_name='tempest-keypair-2116423901',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:14:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cd626aa35a645b5b9ce1f5bf9652c79',ramdisk_id='',reservation_id='r-fcihkavh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-497623291',owner_user_name='tempest-AttachVolumeTestJSON-497623291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:14:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='faa59a3fcaa042999a5f0c357a5ef42c',uuid=e4e4ffe0-0c33-43b5-84bc-91fb7f63b019,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converting VIF {"id": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "address": "fa:16:3e:ef:a8:16", "network": {"id": "f0419abb-91e8-47f1-81ec-fc1e569ed9ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1614592176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cd626aa35a645b5b9ce1f5bf9652c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2877a5ab-64", "ovs_interfaceid": "2877a5ab-6489-44f2-97ca-9ff3dcb3fad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG os_vif [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2877a5ab-64, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:40 user nova-compute[71206]: INFO os_vif [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a8:16,bridge_name='br-int',has_traffic_filtering=True,id=2877a5ab-6489-44f2-97ca-9ff3dcb3fad6,network=Network(f0419abb-91e8-47f1-81ec-fc1e569ed9ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2877a5ab-64')
Jul 27 18:16:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Deleting instance files /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019_del
Jul 27 18:16:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Deletion of /opt/stack/data/nova/instances/e4e4ffe0-0c33-43b5-84bc-91fb7f63b019_del complete
Jul 27 18:16:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Skipping network cache update for instance because it is being deleted. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Jul 27 18:16:40 user nova-compute[71206]: INFO nova.compute.manager [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 18:16:40 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:16:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [{"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:41 user nova-compute[71206]: INFO nova.compute.manager [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Terminating instance
Jul 27 18:16:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] Acquiring lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] No waiting events found dispatching network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:41 user nova-compute[71206]: WARNING nova.compute.manager [req-896b6242-cd7e-4264-bf87-8627201e5c69 req-21e904ab-f924-405f-ac74-546aa3f2774e service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received unexpected event network-vif-plugged-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 for instance with vm_state active and task_state deleting.
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-a10e4d9d-2571-4ff2-902a-b43f3d78d6d1 req-835c0efc-c5f7-4f5e-9145-9018d2273916 service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-unplugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.compute.manager [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Terminating instance
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Instance destroyed successfully.
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lazy-loading 'resources' on Instance uuid 7824a157-7697-4e8a-a212-201cf29cb062 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf97832c-587a-4d11-ae47-d54fd0ccdc78 req-4f76f83d-037d-49f4-a47d-ecb2573cfb64 service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-unplugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2065113690',display_name='tempest-ServerRescueNegativeTestJSON-server-2065113690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2065113690',id=5,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de3796621f174ee4850f31a657d13792',ramdisk_id='',reservation_id='r-iux9t49p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1470187716',owner_user_name='tempest-ServerRescueNegativeTestJSON-1470187716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:06:18Z,user_data=None,user_id='83503c246a474fb1b1591c82962b7a6c',uuid=7824a157-7697-4e8a-a212-201cf29cb062,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converting VIF {"id": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "address": "fa:16:3e:26:ed:17", "network": {"id": "550c9837-7533-4ac0-ac16-5746551a2726", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1067747379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de3796621f174ee4850f31a657d13792", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a69dfd-81", "ovs_interfaceid": "41a69dfd-81be-4ffd-8d26-8ec2103c9ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG os_vif [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41a69dfd-81, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Took 2.23 seconds to deallocate network for instance.
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:42 user nova-compute[71206]: INFO os_vif [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=41a69dfd-81be-4ffd-8d26-8ec2103c9ec9,network=Network(550c9837-7533-4ac0-ac16-5746551a2726),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a69dfd-81')
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Deleting instance files /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062_del
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Deletion of /opt/stack/data/nova/instances/7824a157-7697-4e8a-a212-201cf29cb062_del complete
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:42 user nova-compute[71206]: INFO nova.compute.manager [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 27 18:16:42 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:16:42 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Instance destroyed successfully.
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.objects.instance [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-244505156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-244505156',id=29,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-fx5qtyqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:14:58Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=31095d6b-990e-4fc5-ad0b-1cfed57cc0e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "451955c0-5b30-47e6-95e0-e562c3167201", "address": "fa:16:3e:dd:50:84", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451955c0-5b", "ovs_interfaceid": "451955c0-5b30-47e6-95e0-e562c3167201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_vif [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451955c0-5b, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:43 user nova-compute[71206]: INFO os_vif [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:50:84,bridge_name='br-int',has_traffic_filtering=True,id=451955c0-5b30-47e6-95e0-e562c3167201,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451955c0-5b')
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwkipKUn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:43 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b25c7-92e5-4b49-b1d4-2672c77f7f6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:16:43 user nova-compute[71206]: No targets found.
Jul 27 18:16:43 user nova-compute[71206]: iSNS:
Jul 27 18:16:43 user nova-compute[71206]: No targets found.
Jul 27 18:16:43 user nova-compute[71206]: STATIC:
Jul 27 18:16:43 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:16:43 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:43 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:43 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:16:43 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:43 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:43 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c
Jul 27 18:16:43 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:43 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:43 user nova-compute[71206]: FIRMWARE:
Jul 27 18:16:43 user nova-compute[71206]: No targets found.
Jul 27 18:16:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:16:43 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:16:43 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Deleted allocations for instance e4e4ffe0-0c33-43b5-84bc-91fb7f63b019
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d084f3f0-aad2-4bb5-bc21-096ec21a4ce1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b8026-bd9a-4f12-8549-233760177e28]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:43 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c (non-flash)
Jul 27 18:16:43 user nova-compute[71206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:16:43 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:16:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24207d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c'): ({'sdf'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Removing single pathed devices sdf {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1742697-b64d-4cc1-9a14-1b8bdf591a05]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96e1efd-2ce6-41aa-bb1d-b43e6ff76843]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flushing IO for device /dev/sdf {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6fbbdac0-c356-484d-a090-71e21347e296 tempest-AttachVolumeTestJSON-497623291 tempest-AttachVolumeTestJSON-497623291-project-member] Lock "e4e4ffe0-0c33-43b5-84bc-91fb7f63b019" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.734s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c79717-724d-48b0-9fcc-acb82a1efd54]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41be216-8894-4777-9929-b7691d65de61]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6a521641', '/dev/disk/by-id/scsi-26365333133303038', '/dev/disk/by-id/scsi-1SCST_BIO6a521641-ce3130081fea5aea') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5126cd-da1f-4c88-b143-2960db14335e]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af07a23-0db3-40ec-9bd2-791d56f09aa2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.136s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a86990-13d8-49c2-8179-7c36a238cffa]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260]
Jul 27 18:16:43 user nova-compute[71206]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c, portal: 172.16.0.220,3260] successful.
Jul 27 18:16:43 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Took 0.74 seconds to deallocate network for instance.
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e9d4d42-b57d-44df-b2d3-80ee6fe9ac3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f398e-f420-4221-b8b5-f43d3dbbc6c9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== disconnect_volume: return (436ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Deleting instance files /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6_del
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Deletion of /opt/stack/data/nova/instances/31095d6b-990e-4fc5-ad0b-1cfed57cc0e6_del complete
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.compute.manager [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:43 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Deleted allocations for instance 7824a157-7697-4e8a-a212-201cf29cb062
Jul 27 18:16:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7f4d8f2d-2af6-41ad-a9b2-d77a02e8bd17 tempest-ServerRescueNegativeTestJSON-1470187716 tempest-ServerRescueNegativeTestJSON-1470187716-project-member] Lock "7824a157-7697-4e8a-a212-201cf29cb062" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] Acquiring lock "7824a157-7697-4e8a-a212-201cf29cb062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] Lock "7824a157-7697-4e8a-a212-201cf29cb062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] No waiting events found dispatching network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:44 user nova-compute[71206]: WARNING nova.compute.manager [req-6b7dfc1a-2cd0-4798-9efb-91abb76cb870 req-6cc2c10c-0378-4b42-af03-9aa2ba9bfeea service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received unexpected event network-vif-plugged-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 for instance with vm_state deleted and task_state None.
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:44 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Took 0.68 seconds to deallocate network for instance.
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Received event network-vif-deleted-2877a5ab-6489-44f2-97ca-9ff3dcb3fad6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] Acquiring lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] No waiting events found dispatching network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:44 user nova-compute[71206]: WARNING nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received unexpected event network-vif-plugged-451955c0-5b30-47e6-95e0-e562c3167201 for instance with vm_state active and task_state deleting.
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Received event network-vif-deleted-41a69dfd-81be-4ffd-8d26-8ec2103c9ec9 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:44 user nova-compute[71206]: DEBUG nova.compute.manager [req-9082a557-5e6b-4433-86d4-c042311eda55 req-c6ce7130-80ea-4c8f-92bb-cd7b7376524a service nova] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Received event network-vif-deleted-451955c0-5b30-47e6-95e0-e562c3167201 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:45 user nova-compute[71206]: INFO nova.compute.manager [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Took 0.82 seconds to detach 1 volumes for instance.
Jul 27 18:16:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:45 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Deleted allocations for instance 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6
Jul 27 18:16:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-adefc6dd-a94b-4f16-b329-8b0137c2db6b tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "31095d6b-990e-4fc5-ad0b-1cfed57cc0e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.269s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:16:47 user nova-compute[71206]: INFO nova.compute.claims [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Claim successful on node user
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:16:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.policy [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d22eb4c8854094911f42be4e187f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe752f93ac64502bac3369f21987aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:16:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Creating image(s)
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "/opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "/opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk 1073741824" returned: 0 in 0.050s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Successfully created port: cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Cannot resize image /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.objects.instance [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'migration_context' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Ensure instance console log exists: /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Successfully updated port: cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquired lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-changed-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Refreshing instance network info cache due to event network-changed-cf5a89dd-aa4a-4b0a-8921-82982a371052. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] Acquiring lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updating instance_info_cache with network_info: [{"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Releasing lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Instance network_info: |[{"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] Acquired lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Refreshing network info cache for port cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Start _get_guest_xml network_info=[{"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:16:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:16:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-176474161',display_name='tempest-VolumesSnapshotTestJSON-instance-176474161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-176474161',id=36,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEETq/hETJi1bM3P7KJJIRJfLS1nWG/PVspW4nc96dkER5Lho7FB7QWWpmdgxTZO/jT5QfxnrNgzdRYB4cih7IMbuDqKTVeyCu0/Mi+vgrtisNWw9lKpFXmc8WGq14sTHg==',key_name='tempest-keypair-1539667029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-n0qexkwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:16:49 user nova-compute[71206]:   <uuid>7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5</uuid>
Jul 27 18:16:49 user nova-compute[71206]:   <name>instance-00000024</name>
Jul 27 18:16:49 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:16:49 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:16:49 user nova-compute[71206]:   <metadata>
Jul 27 18:16:49 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:16:49 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-176474161</nova:name>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:16:49</nova:creationTime>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:16:49 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:16:49 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:owner>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:user uuid="10d22eb4c8854094911f42be4e187f08">tempest-VolumesSnapshotTestJSON-1946142319-project-member</nova:user>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:project uuid="7fe752f93ac64502bac3369f21987aaa">tempest-VolumesSnapshotTestJSON-1946142319</nova:project>
Jul 27 18:16:49 user nova-compute[71206]:       </nova:owner>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:16:49 user nova-compute[71206]:       <nova:ports>
Jul 27 18:16:49 user nova-compute[71206]:         <nova:port uuid="cf5a89dd-aa4a-4b0a-8921-82982a371052">
Jul 27 18:16:49 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:16:49 user nova-compute[71206]:         </nova:port>
Jul 27 18:16:49 user nova-compute[71206]:       </nova:ports>
Jul 27 18:16:49 user nova-compute[71206]:     </nova:instance>
Jul 27 18:16:49 user nova-compute[71206]:   </metadata>
Jul 27 18:16:49 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:16:49 user nova-compute[71206]:     <system>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="serial">7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5</entry>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="uuid">7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5</entry>
Jul 27 18:16:49 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:16:49 user nova-compute[71206]:     </system>
Jul 27 18:16:49 user nova-compute[71206]:   </sysinfo>
Jul 27 18:16:49 user nova-compute[71206]:   <os>
Jul 27 18:16:49 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:16:49 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:16:49 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:16:49 user nova-compute[71206]:   </os>
Jul 27 18:16:49 user nova-compute[71206]:   <features>
Jul 27 18:16:49 user nova-compute[71206]:     <acpi/>
Jul 27 18:16:49 user nova-compute[71206]:     <apic/>
Jul 27 18:16:49 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:16:49 user nova-compute[71206]:   </features>
Jul 27 18:16:49 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:16:49 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:16:49 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:16:49 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:16:49 user nova-compute[71206]:   </clock>
Jul 27 18:16:49 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:16:49 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:16:49 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:16:49 user nova-compute[71206]:   </cpu>
Jul 27 18:16:49 user nova-compute[71206]:   <devices>
Jul 27 18:16:49 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:16:49 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:16:49 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk"/>
Jul 27 18:16:49 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:16:49 user nova-compute[71206]:     </disk>
Jul 27 18:16:49 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:16:49 user nova-compute[71206]:       <mac address="fa:16:3e:e2:cc:8d"/>
Jul 27 18:16:49 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:16:49 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:16:49 user nova-compute[71206]:       <target dev="tapcf5a89dd-aa"/>
Jul 27 18:16:49 user nova-compute[71206]:     </interface>
Jul 27 18:16:49 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:16:49 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/console.log" append="off"/>
Jul 27 18:16:49 user nova-compute[71206]:     </serial>
Jul 27 18:16:49 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:16:49 user nova-compute[71206]:     <video>
Jul 27 18:16:49 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:16:49 user nova-compute[71206]:     </video>
Jul 27 18:16:49 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:16:49 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:16:49 user nova-compute[71206]:     </rng>
Jul 27 18:16:49 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:16:49 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:16:49 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:16:49 user nova-compute[71206]:     </memballoon>
Jul 27 18:16:49 user nova-compute[71206]:   </devices>
Jul 27 18:16:49 user nova-compute[71206]: </domain>
Jul 27 18:16:49 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-176474161',display_name='tempest-VolumesSnapshotTestJSON-instance-176474161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-176474161',id=36,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEETq/hETJi1bM3P7KJJIRJfLS1nWG/PVspW4nc96dkER5Lho7FB7QWWpmdgxTZO/jT5QfxnrNgzdRYB4cih7IMbuDqKTVeyCu0/Mi+vgrtisNWw9lKpFXmc8WGq14sTHg==',key_name='tempest-keypair-1539667029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-n0qexkwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG os_vif [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5a89dd-aa, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf5a89dd-aa, col_values=(('external_ids', {'iface-id': 'cf5a89dd-aa4a-4b0a-8921-82982a371052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:cc:8d', 'vm-uuid': '7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:49 user nova-compute[71206]: INFO os_vif [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa')
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No VIF found with MAC fa:16:3e:e2:cc:8d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updated VIF entry in instance network info cache for port cf5a89dd-aa4a-4b0a-8921-82982a371052. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updating instance_info_cache with network_info: [{"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-83c8ab79-6f05-44a8-8452-4562c2cb0d7c req-775cf0ef-dd35-4bb4-bc7d-88d6ce22e013 service nova] Releasing lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:16:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] No waiting events found dispatching network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:51 user nova-compute[71206]: WARNING nova.compute.manager [req-f7e2ec63-fcdd-47b6-8ee7-84cc38112a82 req-55098e3d-dba5-4b1f-9e38-d2ffa36b41fe service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received unexpected event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 for instance with vm_state building and task_state spawning.
Jul 27 18:16:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481813.117968, 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] VM Resumed (Lifecycle Event)
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Instance spawned successfully.
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481813.1198707, 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] VM Started (Lifecycle Event)
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] No waiting events found dispatching network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:53 user nova-compute[71206]: WARNING nova.compute.manager [req-0651f751-ea05-424a-bdcb-de7b66c84c6f req-22e71df3-e84c-458b-ba6b-7d6712321f6a service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received unexpected event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 for instance with vm_state building and task_state spawning.
Jul 27 18:16:53 user nova-compute[71206]: INFO nova.compute.manager [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Took 6.22 seconds to build instance.
Jul 27 18:16:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-70cbf46c-0b0d-490f-afcb-55bf3fd41a48 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:55 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481800.3037553, e4e4ffe0-0c33-43b5-84bc-91fb7f63b019 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:55 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] VM Stopped (Lifecycle Event)
Jul 27 18:16:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-43cfd475-b72b-4eb4-bdd8-48f07bb3c4a1 None None] [instance: e4e4ffe0-0c33-43b5-84bc-91fb7f63b019] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-changed-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Refreshing instance network info cache due to event network-changed-65d7e78e-fc96-41e3-9550-730f0f96107a. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] Acquiring lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] Acquired lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Refreshing network info cache for port 65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481802.645913, 7824a157-7697-4e8a-a212-201cf29cb062 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:57 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] VM Stopped (Lifecycle Event)
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fcdfc3f9-93b3-4ec5-bc59-f03885cf0134 None None] [instance: 7824a157-7697-4e8a-a212-201cf29cb062] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updated VIF entry in instance network info cache for port 65d7e78e-fc96-41e3-9550-730f0f96107a. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating instance_info_cache with network_info: [{"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:16:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-724b2801-de6b-428e-b44d-67684a536e85 req-6e3ac818-8f7d-4542-a5dc-b959369f5b59 service nova] Releasing lock "refresh_cache-4f90e5e6-a1f2-4181-bf15-b91a56a225b2" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:16:58 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481803.0179, 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:16:58 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] VM Stopped (Lifecycle Event)
Jul 27 18:16:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ead2ba42-612e-4b30-9c4e-4cc1c138c19b None None] [instance: 31095d6b-990e-4fc5-ad0b-1cfed57cc0e6] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:59 user nova-compute[71206]: INFO nova.compute.manager [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Terminating instance
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-unplugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] No waiting events found dispatching network-vif-unplugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-acfa9f73-cef8-487f-8378-115ac663b7c1 req-4161f856-5585-4478-be2b-6c61771b3937 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-unplugged-65d7e78e-fc96-41e3-9550-730f0f96107a for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Instance destroyed successfully.
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-208592566',display_name='tempest-TestVolumeBootPattern-server-208592566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-208592566',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-9cco7xqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:15:24Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=4f90e5e6-a1f2-4181-bf15-b91a56a225b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "65d7e78e-fc96-41e3-9550-730f0f96107a", "address": "fa:16:3e:73:0d:95", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d7e78e-fc", "ovs_interfaceid": "65d7e78e-fc96-41e3-9550-730f0f96107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_vif [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d7e78e-fc, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:16:59 user nova-compute[71206]: INFO os_vif [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:0d:95,bridge_name='br-int',has_traffic_filtering=True,id=65d7e78e-fc96-41e3-9550-730f0f96107a,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d7e78e-fc')
Jul 27 18:16:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:16:59 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a492211-756a-46d5-b611-51d2259c1810]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:16:59 user nova-compute[71206]: No targets found.
Jul 27 18:16:59 user nova-compute[71206]: iSNS:
Jul 27 18:16:59 user nova-compute[71206]: No targets found.
Jul 27 18:16:59 user nova-compute[71206]: STATIC:
Jul 27 18:16:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:16:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:59 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:16:59 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:16:59 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:16:59 user nova-compute[71206]: FIRMWARE:
Jul 27 18:16:59 user nova-compute[71206]: No targets found.
Jul 27 18:16:59 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:16:59 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:16:59 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:16:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab13656a-e812-4151-9cc7-8f0158ec4ff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81eae4a-da14-48e7-a666-2a77f7376484]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:17:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:17:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e32935e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.054s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[561314e2-9925-4ca2-a95e-723050690a7d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32181504-611a-4610-b2ee-a195d4499ff3]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b86d71-989e-478f-a743-4c4d15a9cd95]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27363f0-e531-4885-b194-30024d828249]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9adc38-cc78-48f1-b06f-e6fe0198c01b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4869a8-ee10-4ac1-a867-bc719ed3eaa0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]
Jul 27 18:17:00 user nova-compute[71206]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.
Jul 27 18:17:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ccb48-3f57-49ed-8595-157cf7d417c9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (392ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:17:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Deleting instance files /opt/stack/data/nova/instances/4f90e5e6-a1f2-4181-bf15-b91a56a225b2_del
Jul 27 18:17:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Deletion of /opt/stack/data/nova/instances/4f90e5e6-a1f2-4181-bf15-b91a56a225b2_del complete
Jul 27 18:17:00 user nova-compute[71206]: INFO nova.compute.manager [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 27 18:17:00 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-9064c4fc-7cbd-4508-8d67-9077b1ac1f68 req-c26ddfbb-7261-4e07-94ee-7cf67a516c78 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-deleted-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:01 user nova-compute[71206]: INFO nova.compute.manager [req-9064c4fc-7cbd-4508-8d67-9077b1ac1f68 req-c26ddfbb-7261-4e07-94ee-7cf67a516c78 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Neutron deleted interface 65d7e78e-fc96-41e3-9550-730f0f96107a; detaching it from the instance and deleting it from the info cache
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.network.neutron [req-9064c4fc-7cbd-4508-8d67-9077b1ac1f68 req-c26ddfbb-7261-4e07-94ee-7cf67a516c78 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:01 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Took 0.85 seconds to deallocate network for instance.
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-9064c4fc-7cbd-4508-8d67-9077b1ac1f68 req-c26ddfbb-7261-4e07-94ee-7cf67a516c78 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Detach interface failed, port_id=65d7e78e-fc96-41e3-9550-730f0f96107a, reason: Instance 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] Acquiring lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] No waiting events found dispatching network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:17:01 user nova-compute[71206]: WARNING nova.compute.manager [req-2e9a1174-44f0-4f97-84a2-0d194990064f req-f2d0b188-f41b-45c3-8d93-4394cce80ba8 service nova] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Received unexpected event network-vif-plugged-65d7e78e-fc96-41e3-9550-730f0f96107a for instance with vm_state active and task_state deleting.
Jul 27 18:17:02 user nova-compute[71206]: INFO nova.compute.manager [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 18:17:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:02 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:17:02 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:17:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:02 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance 4f90e5e6-a1f2-4181-bf15-b91a56a225b2
Jul 27 18:17:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4c626a5b-b692-4385-9cf9-6a91b307f4d7 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "4f90e5e6-a1f2-4181-bf15-b91a56a225b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.407s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:13 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:17:14 user nova-compute[71206]: INFO nova.compute.claims [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Claim successful on node user
Jul 27 18:17:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:17:14 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.policy [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c1d017cd91d4121b90577b54b28fd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4785a59769df4f2b8e1a027469d25d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:17:14 user nova-compute[71206]: INFO nova.virt.block_device [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Booting with volume ef8afa97-c884-4c6f-9659-aa4551aa79d0 at /dev/vda
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.utils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15193805-9bc7-44af-8215-b5a9a6a9fb5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8819ce8-1383-49d9-a5b6-d3b55af9df83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b9747-39eb-4e87-b1f8-4c82dd3291c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f1d19e-3d78-408c-8a3b-db492951256e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:14 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:17:14 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d6517-0c47-45c0-ba92-7ded2df0b28a]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG os_brick.utils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating existing volume attachment record: 813044b9-a910-47b5-86e1-96ac13e37394 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481819.913155, 4f90e5e6-a1f2-4181-bf15-b91a56a225b2 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:17:14 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] VM Stopped (Lifecycle Event)
Jul 27 18:17:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4822e4b8-964a-4be8-9e01-6b8062256a93 None None] [instance: 4f90e5e6-a1f2-4181-bf15-b91a56a225b2] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:17:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Successfully created port: 67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:17:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Successfully updated port: 67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-changed-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.compute.manager [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Refreshing instance network info cache due to event network-changed-67d4dbb8-05a2-4ae0-a4f6-c34557360b95. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance network_info: |[{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:16 user nova-compute[71206]: DEBUG nova.network.neutron [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Refreshing network info cache for port 67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:17:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updated VIF entry in instance network info cache for port 67d4dbb8-05a2-4ae0-a4f6-c34557360b95. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:17:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-6e2b60b8-9607-4f08-b92b-13fe3a367af5 req-36a019b7-6efb-41a6-bd6f-17dae9c7002c service nova] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:17:21 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Creating image(s)
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Ensure instance console log exists: /opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start _get_guest_xml network_info=[{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '813044b9-a910-47b5-86e1-96ac13e37394', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f64c63f-3a78-4f85-87d3-33590f43b5fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'serial': 'ef8afa97-c884-4c6f-9659-aa4551aa79d0'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:17:21 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:21 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:21 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:17:21 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:17:21 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31796257-6006-4f0a-b68a-947a8d9738fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:17:21 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7ac96-465c-409e-acc2-c3e0e006d1cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0] added
Jul 27 18:17:21 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba79c0-0387-4c3e-9e24-41b91e935c89]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf8f8e-9311-4f24-9dca-6a02b99a1f3e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHpjnoGh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHpjnoGh" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2cddd-e2f9-47a3-9564-94853be5099a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHpjnoGh'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d428f3f1-b059-484a-8a81-8058a6c9278a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[03680e46-e643-485c-8e37-cf2ed873e49b]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9070fe7-9456-4ece-9625-9eade12651e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]
Jul 27 18:17:22 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.
Jul 27 18:17:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc7a6a1-6732-4988-8e88-c438dcfa627c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4fa89-df04-4c4a-beac-cae938805420]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:22 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bc1776-9f91-4ff5-a765-3cebe681d0d6]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:17:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23365373137316661', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365373137316661', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:17:23 user nova-compute[71206]:   <uuid>0f64c63f-3a78-4f85-87d3-33590f43b5fb</uuid>
Jul 27 18:17:23 user nova-compute[71206]:   <name>instance-00000025</name>
Jul 27 18:17:23 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:17:23 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:17:23 user nova-compute[71206]:   <metadata>
Jul 27 18:17:23 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:17:23 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:17:23 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherA-server-346661414</nova:name>
Jul 27 18:17:23 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:17:21</nova:creationTime>
Jul 27 18:17:23 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:17:23 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:17:23 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:17:23 user nova-compute[71206]:       <nova:owner>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:user uuid="8c1d017cd91d4121b90577b54b28fd89">tempest-ServerActionsTestOtherA-543896870-project-member</nova:user>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:project uuid="4785a59769df4f2b8e1a027469d25d79">tempest-ServerActionsTestOtherA-543896870</nova:project>
Jul 27 18:17:23 user nova-compute[71206]:       </nova:owner>
Jul 27 18:17:23 user nova-compute[71206]:       <nova:ports>
Jul 27 18:17:23 user nova-compute[71206]:         <nova:port uuid="67d4dbb8-05a2-4ae0-a4f6-c34557360b95">
Jul 27 18:17:23 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:17:23 user nova-compute[71206]:         </nova:port>
Jul 27 18:17:23 user nova-compute[71206]:       </nova:ports>
Jul 27 18:17:23 user nova-compute[71206]:     </nova:instance>
Jul 27 18:17:23 user nova-compute[71206]:   </metadata>
Jul 27 18:17:23 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:17:23 user nova-compute[71206]:     <system>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="serial">0f64c63f-3a78-4f85-87d3-33590f43b5fb</entry>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="uuid">0f64c63f-3a78-4f85-87d3-33590f43b5fb</entry>
Jul 27 18:17:23 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:17:23 user nova-compute[71206]:     </system>
Jul 27 18:17:23 user nova-compute[71206]:   </sysinfo>
Jul 27 18:17:23 user nova-compute[71206]:   <os>
Jul 27 18:17:23 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:17:23 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:17:23 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:17:23 user nova-compute[71206]:   </os>
Jul 27 18:17:23 user nova-compute[71206]:   <features>
Jul 27 18:17:23 user nova-compute[71206]:     <acpi/>
Jul 27 18:17:23 user nova-compute[71206]:     <apic/>
Jul 27 18:17:23 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:17:23 user nova-compute[71206]:   </features>
Jul 27 18:17:23 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:17:23 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:17:23 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:17:23 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:17:23 user nova-compute[71206]:   </clock>
Jul 27 18:17:23 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:17:23 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:17:23 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:17:23 user nova-compute[71206]:   </cpu>
Jul 27 18:17:23 user nova-compute[71206]:   <devices>
Jul 27 18:17:23 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:17:23 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:17:23 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:17:23 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:17:23 user nova-compute[71206]:       <serial>ef8afa97-c884-4c6f-9659-aa4551aa79d0</serial>
Jul 27 18:17:23 user nova-compute[71206]:     </disk>
Jul 27 18:17:23 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:17:23 user nova-compute[71206]:       <mac address="fa:16:3e:4c:6c:85"/>
Jul 27 18:17:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:17:23 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:17:23 user nova-compute[71206]:       <target dev="tap67d4dbb8-05"/>
Jul 27 18:17:23 user nova-compute[71206]:     </interface>
Jul 27 18:17:23 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:17:23 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb/console.log" append="off"/>
Jul 27 18:17:23 user nova-compute[71206]:     </serial>
Jul 27 18:17:23 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:17:23 user nova-compute[71206]:     <video>
Jul 27 18:17:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:17:23 user nova-compute[71206]:     </video>
Jul 27 18:17:23 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:17:23 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:17:23 user nova-compute[71206]:     </rng>
Jul 27 18:17:23 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:17:23 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:17:23 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:17:23 user nova-compute[71206]:     </memballoon>
Jul 27 18:17:23 user nova-compute[71206]:   </devices>
Jul 27 18:17:23 user nova-compute[71206]: </domain>
Jul 27 18:17:23 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG os_vif [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d4dbb8-05, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67d4dbb8-05, col_values=(('external_ids', {'iface-id': '67d4dbb8-05a2-4ae0-a4f6-c34557360b95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:6c:85', 'vm-uuid': '0f64c63f-3a78-4f85-87d3-33590f43b5fb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:23 user nova-compute[71206]: INFO os_vif [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05')
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:17:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No VIF found with MAC fa:16:3e:4c:6c:85, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:17:24 user nova-compute[71206]: WARNING nova.compute.manager [req-b8ab2013-c6e8-4c27-bba6-e7fa7f0844dd req-b022874f-6ea3-49de-9ff0-7ed3cf149f5b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state building and task_state spawning.
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481846.7748795, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Resumed (Lifecycle Event)
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance spawned successfully.
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481846.7765973, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Started (Lifecycle Event)
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Took 5.05 seconds to spawn the instance on the hypervisor.
Jul 27 18:17:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:17:26 user nova-compute[71206]: INFO nova.compute.manager [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Took 12.99 seconds to build instance.
Jul 27 18:17:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:17:27 user nova-compute[71206]: WARNING nova.compute.manager [req-4f787a95-166a-48d8-a2eb-a5dbe9f7482e req-48c4bab6-b0ca-4d79-80da-c0e63f50eeed service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state None.
Jul 27 18:17:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a0f49bcb-15ab-4a6b-863c-2431ef1685bd tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.099s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing instance network info cache due to event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updated VIF entry in instance network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2140c3-63fb-4d65-8386-794ec89849d8 req-de9ece2e-f23e-477d-ba8e-daaec5b2710c service nova] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:30 user nova-compute[71206]: INFO nova.compute.manager [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Attaching volume 80541db3-3165-411d-a7a5-1eba697d6a0c to /dev/vdb
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.utils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3365d-865b-4eaf-8520-8d2abe15d49e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479bf79-0256-443e-acd3-a4d8365e7334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b6d079-89ba-4cd6-8a7e-8799b049f4d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01931da5-4398-45d1-bfd1-ec6241e07028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:30 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:17:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c21c96-c02d-4685-bc00-98f2d83ffb26]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG os_brick.utils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:30 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating existing volume attachment record: 6286efaa-cb61-423f-9058-4471a1916444 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:33 user nova-compute[71206]: INFO nova.compute.manager [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Terminating instance
Jul 27 18:17:33 user nova-compute[71206]: DEBUG nova.compute.manager [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-unplugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] No waiting events found dispatching network-vif-unplugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:17:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-5576f889-f5fc-4948-b84e-d69b82ae0cf5 req-44cdb54e-3f1f-47af-89dc-ac1ddeacfe36 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-unplugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:17:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Instance destroyed successfully.
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid 33b47dd0-da00-45ae-baa5-7d54f8df84ab {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1686647698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1686647698',id=23,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6c08p1gd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:10:07Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=33b47dd0-da00-45ae-baa5-7d54f8df84ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "address": "fa:16:3e:66:20:f1", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fac421-92", "ovs_interfaceid": "30fac421-921c-493d-a42a-dde3e2ad4ef7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG os_vif [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fac421-92, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:17:34 user nova-compute[71206]: INFO os_vif [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:20:f1,bridge_name='br-int',has_traffic_filtering=True,id=30fac421-921c-493d-a42a-dde3e2ad4ef7,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fac421-92')
Jul 27 18:17:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Deleting instance files /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab_del
Jul 27 18:17:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Deletion of /opt/stack/data/nova/instances/33b47dd0-da00-45ae-baa5-7d54f8df84ab_del complete
Jul 27 18:17:34 user nova-compute[71206]: INFO nova.compute.manager [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 27 18:17:34 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:17:34 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:35 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Took 1.29 seconds to deallocate network for instance.
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-da745b35-be2e-4a2c-b149-c9141356c4cc req-ad7e2427-e0b2-40f4-afbb-63b53dab1b82 service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-deleted-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] Acquiring lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] No waiting events found dispatching network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:17:35 user nova-compute[71206]: WARNING nova.compute.manager [req-283490a0-7fc0-4335-bd88-846651070978 req-30017109-8524-4aca-a975-f665005a3c2c service nova] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Received unexpected event network-vif-plugged-30fac421-921c-493d-a42a-dde3e2ad4ef7 for instance with vm_state deleted and task_state None.
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:17:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:35 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Deleted allocations for instance 33b47dd0-da00-45ae-baa5-7d54f8df84ab
Jul 27 18:17:36 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-8d31449d-dda6-4d08-8829-6253e762c1cc tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "33b47dd0-da00-45ae-baa5-7d54f8df84ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:17:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmgaBzOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:17:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:17:40 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7977MB free_disk=25.34667205810547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c205be46-d52b-43e7-8077-b5561369aa07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:17:40 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb54fac-e0b3-44a6-bd34-b9395b3f7887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c] added
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bffccf7-5f83-4448-9562-d5dc51ef553d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0d66c-ba19-4fe7-b32e-1a4c890567df]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmgaBzOt {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MmgaBzOt" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe718b4-607b-436a-bcf1-7ac4cc8a9fd8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MmgaBzOt'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc8f55a-5582-4eda-98de-59c6ba59bd4c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61138a6d-a817-49e9-9f27-d955c7c5e672]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40011563-7a71-451e-8fe6-7fdde0a8c4cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260]
Jul 27 18:17:40 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260] successful.
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe0d08-500c-451f-b6a6-834c24128494]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04620f19-7e9e-40ef-bf85-597f725a22bd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)
Jul 27 18:17:40 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7872a3c8-9ebc-4693-961e-e2112dce1d7d]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmgaBzOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:17:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26135393639366537', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135393639366537', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:17:41 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:17:41 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:17:41 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:17:41 user nova-compute[71206]:   <serial>80541db3-3165-411d-a7a5-1eba697d6a0c</serial>
Jul 27 18:17:41 user nova-compute[71206]: </disk>
Jul 27 18:17:41 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No VIF found with MAC fa:16:3e:d3:f0:a2, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b66da097-c471-480b-a5d2-34df3e0b64b9 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.895s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [{"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-3564a8f7-d3c6-4a44-a8e0-05e6123987e5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:44 user nova-compute[71206]: INFO nova.compute.manager [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Detaching volume 80541db3-3165-411d-a7a5-1eba697d6a0c
Jul 27 18:17:44 user nova-compute[71206]: INFO nova.virt.block_device [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Attempting to driver detach volume 80541db3-3165-411d-a7a5-1eba697d6a0c from mountpoint /dev/vdb
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Attempting to detach device vdb from instance 74f56d44-bada-4942-b47d-a0312ce2dc97 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:17:44 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:17:44 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:17:44 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:17:44 user nova-compute[71206]:   <serial>80541db3-3165-411d-a7a5-1eba697d6a0c</serial>
Jul 27 18:17:44 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:17:44 user nova-compute[71206]: </disk>
Jul 27 18:17:44 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:17:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully detached device vdb from instance 74f56d44-bada-4942-b47d-a0312ce2dc97 from the persistent domain config.
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74f56d44-bada-4942-b47d-a0312ce2dc97 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:17:44 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:17:44 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:17:44 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:17:44 user nova-compute[71206]:   <serial>80541db3-3165-411d-a7a5-1eba697d6a0c</serial>
Jul 27 18:17:44 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:17:44 user nova-compute[71206]: </disk>
Jul 27 18:17:44 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481864.8763268, 74f56d44-bada-4942-b47d-a0312ce2dc97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:17:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully detached device vdb from instance 74f56d44-bada-4942-b47d-a0312ce2dc97 from the live domain config.
Jul 27 18:17:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MmgaBzOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:44 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bccfac-fbfe-41e9-8d64-b589794eb9d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:17:44 user nova-compute[71206]: No targets found.
Jul 27 18:17:44 user nova-compute[71206]: iSNS:
Jul 27 18:17:44 user nova-compute[71206]: No targets found.
Jul 27 18:17:44 user nova-compute[71206]: STATIC:
Jul 27 18:17:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c
Jul 27 18:17:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:17:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:17:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:17:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:17:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:17:44 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:17:44 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:17:44 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:17:44 user nova-compute[71206]: FIRMWARE:
Jul 27 18:17:44 user nova-compute[71206]: No targets found.
Jul 27 18:17:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:17:44 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:17:44 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e17c0-8099-45a2-a324-4b9aa6f6021e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75ff63e-5891-4ba0-8a2d-72381e534f0d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:44 user nova-compute[71206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)
Jul 27 18:17:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:17:44 user nova-compute[71206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c (non-flash)
Jul 27 18:17:44 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:17:44 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24326b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:44 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec055879-42a1-45a9-8c3e-c2dd08c360dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56f744-5155-4d8c-87b3-f47094edbc77]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393cd55-980c-431b-a9e8-bc627048792f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51665c1-1275-4ec2-92bb-8b6f0769bdd3]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba52b35-83a2-4760-8030-f1b71cf6596c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80634ed0-727a-49aa-997b-d08c0de4f78a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260]
Jul 27 18:17:45 user nova-compute[71206]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c, portal: 172.16.0.220,3260] successful.
Jul 27 18:17:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80541db3-3165-411d-a7a5-1eba697d6a0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8534d48-5447-4833-8522-a72086e7cd60]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== disconnect_volume: return (321ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:17:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-997ac838-5eb4-4f73-924a-c8215e67d652 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:49 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481854.085884, 33b47dd0-da00-45ae-baa5-7d54f8df84ab => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:17:49 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] VM Stopped (Lifecycle Event)
Jul 27 18:17:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-50f60186-9459-4b16-a3ba-2fcad2b02877 None None] [instance: 33b47dd0-da00-45ae-baa5-7d54f8df84ab] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:17:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:17:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:17:51 user nova-compute[71206]: INFO nova.compute.claims [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Claim successful on node user
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:17:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:17:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:17:52 user nova-compute[71206]: INFO nova.virt.block_device [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Booting with volume b1d44431-378c-4764-8a05-5290f14c5369 at /dev/vda
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.utils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be39268-9da2-4041-9792-3d787525ed95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab322b07-4172-403b-a9f1-80b415aae70d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c0250-d44b-4fa0-9796-c6bf6d409131]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08e8fda-3f5e-4165-9d26-927ea17fff2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:17:52 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:17:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d53bd-ce0c-4b35-997a-2facba0e4a75]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG os_brick.utils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating existing volume attachment record: 508dc893-ea88-44ea-8d3b-59e89b814b4b {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:17:52 user nova-compute[71206]: DEBUG nova.policy [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:17:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Successfully created port: 6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Successfully updated port: 6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing instance network info cache due to event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] Acquiring lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating instance_info_cache with network_info: [{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Instance network_info: |[{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] Acquired lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:17:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:17:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updated VIF entry in instance network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:17:55 user nova-compute[71206]: DEBUG nova.network.neutron [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating instance_info_cache with network_info: [{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:17:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85853c13-d334-486b-9c6e-6cdf0b219153 req-ccaf80ff-ce52-4f5c-ad6e-5a61cababa3c service nova] Releasing lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:17:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Creating image(s)
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Ensure instance console log exists: /opt/stack/data/nova/instances/7a3a1a62-0246-475c-b346-35aab836bf84/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Start _get_guest_xml network_info=[{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '508dc893-ea88-44ea-8d3b-59e89b814b4b', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a3a1a62-0246-475c-b346-35aab836bf84', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1d44431-378c-4764-8a05-5290f14c5369', 'serial': 'b1d44431-378c-4764-8a05-5290f14c5369'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:17:59 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:59 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:17:59 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:17:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:17:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:18:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:18:00 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[989584b0-e078-47f9-bb4c-5fff5c212115]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:18:00 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1024fa4b-5f2e-4415-a8b8-233c98ad6363]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369] added
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b361e249-bd70-4be7-aaec-f1e3c55e141b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00454b25-d84a-4341-bbf0-46bcc3462d35]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxqVfcLE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IxqVfcLE" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb82c0d-45f5-4d9a-a1ea-ef309dbd463e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IxqVfcLE'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29017d31-32d0-49c7-8239-678dc7c25f65]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017c115-8ca8-421e-a050-9d38cba8b7b6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a59c25-5223-40f7-8681-04fc078c7c61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]
Jul 27 18:18:00 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aa670a-09bc-4b33-814c-9ef38147db76]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad790faa-b255-4ec1-bd32-36897600bdc0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:00 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7321cc-380e-445f-a6dc-575d2df93712]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23130313531666634', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313531666634', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610966681',display_name='tempest-TestVolumeBootPattern-server-1610966681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610966681',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-8g2p018d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:17:52Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=7a3a1a62-0246-475c-b346-35aab836bf84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a3a1a62-0246-475c-b346-35aab836bf84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:18:01 user nova-compute[71206]:   <uuid>7a3a1a62-0246-475c-b346-35aab836bf84</uuid>
Jul 27 18:18:01 user nova-compute[71206]:   <name>instance-00000026</name>
Jul 27 18:18:01 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:18:01 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:18:01 user nova-compute[71206]:   <metadata>
Jul 27 18:18:01 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:18:01 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:18:01 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-server-1610966681</nova:name>
Jul 27 18:18:01 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:17:59</nova:creationTime>
Jul 27 18:18:01 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:18:01 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:18:01 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:18:01 user nova-compute[71206]:       <nova:owner>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:18:01 user nova-compute[71206]:       </nova:owner>
Jul 27 18:18:01 user nova-compute[71206]:       <nova:ports>
Jul 27 18:18:01 user nova-compute[71206]:         <nova:port uuid="6fe65ecf-1531-49a0-bd76-84de8b4cd914">
Jul 27 18:18:01 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 18:18:01 user nova-compute[71206]:         </nova:port>
Jul 27 18:18:01 user nova-compute[71206]:       </nova:ports>
Jul 27 18:18:01 user nova-compute[71206]:     </nova:instance>
Jul 27 18:18:01 user nova-compute[71206]:   </metadata>
Jul 27 18:18:01 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:18:01 user nova-compute[71206]:     <system>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="serial">7a3a1a62-0246-475c-b346-35aab836bf84</entry>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="uuid">7a3a1a62-0246-475c-b346-35aab836bf84</entry>
Jul 27 18:18:01 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:18:01 user nova-compute[71206]:     </system>
Jul 27 18:18:01 user nova-compute[71206]:   </sysinfo>
Jul 27 18:18:01 user nova-compute[71206]:   <os>
Jul 27 18:18:01 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:18:01 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:18:01 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:18:01 user nova-compute[71206]:   </os>
Jul 27 18:18:01 user nova-compute[71206]:   <features>
Jul 27 18:18:01 user nova-compute[71206]:     <acpi/>
Jul 27 18:18:01 user nova-compute[71206]:     <apic/>
Jul 27 18:18:01 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:18:01 user nova-compute[71206]:   </features>
Jul 27 18:18:01 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:18:01 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:18:01 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:18:01 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:18:01 user nova-compute[71206]:   </clock>
Jul 27 18:18:01 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:18:01 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:18:01 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:18:01 user nova-compute[71206]:   </cpu>
Jul 27 18:18:01 user nova-compute[71206]:   <devices>
Jul 27 18:18:01 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:18:01 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:18:01 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:18:01 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:18:01 user nova-compute[71206]:       <serial>b1d44431-378c-4764-8a05-5290f14c5369</serial>
Jul 27 18:18:01 user nova-compute[71206]:     </disk>
Jul 27 18:18:01 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:18:01 user nova-compute[71206]:       <mac address="fa:16:3e:ff:46:ae"/>
Jul 27 18:18:01 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:18:01 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:18:01 user nova-compute[71206]:       <target dev="tap6fe65ecf-15"/>
Jul 27 18:18:01 user nova-compute[71206]:     </interface>
Jul 27 18:18:01 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:18:01 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/7a3a1a62-0246-475c-b346-35aab836bf84/console.log" append="off"/>
Jul 27 18:18:01 user nova-compute[71206]:     </serial>
Jul 27 18:18:01 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:18:01 user nova-compute[71206]:     <video>
Jul 27 18:18:01 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:18:01 user nova-compute[71206]:     </video>
Jul 27 18:18:01 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:18:01 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:18:01 user nova-compute[71206]:     </rng>
Jul 27 18:18:01 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:18:01 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:18:01 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:18:01 user nova-compute[71206]:     </memballoon>
Jul 27 18:18:01 user nova-compute[71206]:   </devices>
Jul 27 18:18:01 user nova-compute[71206]: </domain>
Jul 27 18:18:01 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610966681',display_name='tempest-TestVolumeBootPattern-server-1610966681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610966681',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-8g2p018d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:17:52Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=7a3a1a62-0246-475c-b346-35aab836bf84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG os_vif [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fe65ecf-15, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fe65ecf-15, col_values=(('external_ids', {'iface-id': '6fe65ecf-1531-49a0-bd76-84de8b4cd914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:46:ae', 'vm-uuid': '7a3a1a62-0246-475c-b346-35aab836bf84'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:01 user nova-compute[71206]: INFO os_vif [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15')
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:18:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:ff:46:ae, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:18:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] No waiting events found dispatching network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:18:03 user nova-compute[71206]: WARNING nova.compute.manager [req-e5014117-65ed-4a4e-b1d6-95bef8d15e67 req-0108293c-52c9-4a4f-be20-713fdc5a6b06 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received unexpected event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 for instance with vm_state building and task_state spawning.
Jul 27 18:18:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] No waiting events found dispatching network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:18:05 user nova-compute[71206]: WARNING nova.compute.manager [req-b56cfbea-baca-481e-a637-0d5ae70c69e3 req-8d54534c-9f5a-489d-8ad2-8e128b7c97bb service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received unexpected event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 for instance with vm_state building and task_state spawning.
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481885.3413513, 7a3a1a62-0246-475c-b346-35aab836bf84 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] VM Resumed (Lifecycle Event)
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Instance spawned successfully.
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481885.3459082, 7a3a1a62-0246-475c-b346-35aab836bf84 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] VM Started (Lifecycle Event)
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Took 5.53 seconds to spawn the instance on the hypervisor.
Jul 27 18:18:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:18:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Took 14.19 seconds to build instance.
Jul 27 18:18:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7c2604cd-e4fd-4c07-949e-7cbefc472335 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.435s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:18:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:24 user nova-compute[71206]: INFO nova.compute.manager [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Terminating instance
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-90b5935b-0a15-40bf-9a8b-90480459b07c req-81300414-2995-420d-9dac-880b1a5886a6 service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-unplugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Instance destroyed successfully.
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-778864700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-778864700',id=14,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-6cm75eep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:06:21Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=3564a8f7-d3c6-4a44-a8e0-05e6123987e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "address": "fa:16:3e:18:ed:63", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da326ce-e5", "ovs_interfaceid": "2da326ce-e53a-43c4-9cf5-0ba3bab0527d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_vif [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2da326ce-e5, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:18:24 user nova-compute[71206]: INFO os_vif [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:ed:63,bridge_name='br-int',has_traffic_filtering=True,id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2da326ce-e5')
Jul 27 18:18:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smagXquQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:18:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[169df524-c505-4e12-8543-2b37a308add6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:18:24 user nova-compute[71206]: No targets found.
Jul 27 18:18:24 user nova-compute[71206]: iSNS:
Jul 27 18:18:24 user nova-compute[71206]: No targets found.
Jul 27 18:18:24 user nova-compute[71206]: STATIC:
Jul 27 18:18:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae
Jul 27 18:18:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:18:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:18:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:18:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:18:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:18:24 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:18:24 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:18:24 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:18:24 user nova-compute[71206]: FIRMWARE:
Jul 27 18:18:24 user nova-compute[71206]: No targets found.
Jul 27 18:18:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:18:24 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:18:24 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7522f7-8514-4734-bff8-af17417f9825]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3ca91-0995-46a1-a19d-ce7f19ff927b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:24 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:24 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:24 user nova-compute[71206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae (non-flash)
Jul 27 18:18:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c660430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a40ac6-ac8a-4fc1-b2bf-1febcae06823]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d430a13-e060-486b-b2cf-ed4e0af7d198]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c1a80-751c-4d0a-af86-8c782e3d4c30]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.101s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b633d-2878-4b33-9224-cea507223cf5]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO52c4fcca-5e83c9b5dfe6507c', '/dev/disk/by-id/scsi-23565383363396235', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_52c4fcca') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335f927-1c9f-44d5-86dc-ab918405b22d]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c41f5bc-ca5d-4ae5-adca-431298eaa0af]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f461d7e-2f7b-4a4e-a3e4-771bfd819336]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260]
Jul 27 18:18:25 user nova-compute[71206]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae, portal: 172.16.0.220,3260] successful.
Jul 27 18:18:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d15f2530-b185-42cc-a3c9-d10b3cb919ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc3c481-48b9-4724-b41b-7a88f15fd512]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] <== disconnect_volume: return (361ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:18:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Deleting instance files /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5_del
Jul 27 18:18:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Deletion of /opt/stack/data/nova/instances/3564a8f7-d3c6-4a44-a8e0-05e6123987e5_del complete
Jul 27 18:18:25 user nova-compute[71206]: INFO nova.compute.manager [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 27 18:18:25 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:18:25 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-1eee1993-7ba5-4e73-b25a-8d6147602adb req-5daf44f5-5236-4f49-ad13-6c916ef6829e service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-deleted-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:26 user nova-compute[71206]: INFO nova.compute.manager [req-1eee1993-7ba5-4e73-b25a-8d6147602adb req-5daf44f5-5236-4f49-ad13-6c916ef6829e service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Neutron deleted interface 2da326ce-e53a-43c4-9cf5-0ba3bab0527d; detaching it from the instance and deleting it from the info cache
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.network.neutron [req-1eee1993-7ba5-4e73-b25a-8d6147602adb req-5daf44f5-5236-4f49-ad13-6c916ef6829e service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-1eee1993-7ba5-4e73-b25a-8d6147602adb req-5daf44f5-5236-4f49-ad13-6c916ef6829e service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Detach interface failed, port_id=2da326ce-e53a-43c4-9cf5-0ba3bab0527d, reason: Instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:18:26 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Took 0.96 seconds to deallocate network for instance.
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] Acquiring lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] No waiting events found dispatching network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:18:26 user nova-compute[71206]: WARNING nova.compute.manager [req-a7bfd9f7-e6fe-4cde-a2dd-297f49623ad8 req-fac879cb-0988-48f6-b0fc-63ceaa1aa73d service nova] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Received unexpected event network-vif-plugged-2da326ce-e53a-43c4-9cf5-0ba3bab0527d for instance with vm_state active and task_state deleting.
Jul 27 18:18:27 user nova-compute[71206]: INFO nova.compute.manager [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Took 0.81 seconds to detach 1 volumes for instance.
Jul 27 18:18:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:27 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:18:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:18:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:27 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Deleted allocations for instance 3564a8f7-d3c6-4a44-a8e0-05e6123987e5
Jul 27 18:18:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-37f0f87d-c016-436b-a416-21c82195907c tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "3564a8f7-d3c6-4a44-a8e0-05e6123987e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.550s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-changed-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.compute.manager [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Refreshing instance network info cache due to event network-changed-cf5a89dd-aa4a-4b0a-8921-82982a371052. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] Acquiring lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] Acquired lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Refreshing network info cache for port cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.objects.instance [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:18:38 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Ignoring supplied device name: /dev/vdb
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:38 user nova-compute[71206]: INFO nova.compute.manager [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Attaching volume 1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b to /dev/vdb
Jul 27 18:18:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updated VIF entry in instance network info cache for port cf5a89dd-aa4a-4b0a-8921-82982a371052. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updating instance_info_cache with network_info: [{"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.utils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a0618-4184-4efc-8d25-bd32b13243d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f2db4cb-e5bf-4807-acd9-d6134786d5e6 req-eadf8f95-6035-46da-bce3-03db03308004 service nova] Releasing lock "refresh_cache-7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72e5aa8-18ee-4d91-a2ec-6796efd1a3f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[615e7341-8b39-4ffc-b869-4e5ea6c408d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0cfb0-3516-4980-a598-0ade89faa4f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:18:39 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b022f-060c-48dd-9a41-f621dac93814]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG os_brick.utils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updating existing volume attachment record: 265b69f0-37fe-4362-9ad0-4d4dc9c29efa {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481904.766132, 3564a8f7-d3c6-4a44-a8e0-05e6123987e5 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:18:39 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] VM Stopped (Lifecycle Event)
Jul 27 18:18:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bc98e945-2a37-43d4-91b1-b48ae58a2c5c None None] [instance: 3564a8f7-d3c6-4a44-a8e0-05e6123987e5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:18:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=25.33110809326172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7a3a1a62-0246-475c-b346-35aab836bf84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:18:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:18:41 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:18:41 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:18:41 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:18:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:18:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:44 user nova-compute[71206]: INFO nova.compute.manager [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] instance snapshotting
Jul 27 18:18:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Beginning live snapshot process
Jul 27 18:18:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json -f qcow2 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91.delta 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91.delta 1073741824" returned: 0 in 0.059s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 18:18:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:18:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] COPY block job progress, current cursor: 23396352 final cursor: 75563008 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=71206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 18:18:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 18:18:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91.delta /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWmdoYKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:18:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:18:47 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:18:47 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:18:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07f3aa-c1a2-4923-937a-85b0b4e61a48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:18:47 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb5a06-5131-48b2-9899-b2c0a7846067]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b] added
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f233340a-c480-493c-9ed5-171b72c4d9aa]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4daeb3d-f3bf-42f7-a7c7-d4d1e84e0971]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWmdoYKr {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWmdoYKr" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3401091-67ef-41ff-a889-3f99d61c72e0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWmdoYKr'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91.delta /opt/stack/data/nova/instances/snapshots/tmpcy5r2imk/597899aec724402a91ae99f9d5c9cf91" returned: 0 in 0.607s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Snapshot extracted, beginning image upload
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[312879b6-5383-4a03-bae2-27c163338178]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80511cb1-0a44-4ba8-9c4b-d8c7cb4045d6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00d914-57e8-4c0a-9aa0-1090397fda0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260]
Jul 27 18:18:48 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260] successful.
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b4ddb-aa60-4abb-a207-3c1643ab9c48]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c391d254-02cb-4d8b-8801-30e620ddc603]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:18:48 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:18:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d2896-a641-45ef-a052-3718e25e5ae7]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:18:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWmdoYKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23638633066383463', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638633066383463', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:18:49 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:18:49 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:18:49 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:18:49 user nova-compute[71206]:   <serial>1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b</serial>
Jul 27 18:18:49 user nova-compute[71206]: </disk>
Jul 27 18:18:49 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:18:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:18:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:18:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No VIF found with MAC fa:16:3e:e2:cc:8d, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:18:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-436c1b99-32e2-4755-81db-4b4807dcee1a tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.232s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Snapshot image upload complete
Jul 27 18:18:51 user nova-compute[71206]: INFO nova.compute.manager [None req-e85daee3-eb9e-4ef8-9386-5ec5e9831434 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Took 6.96 seconds to snapshot the instance on the hypervisor.
Jul 27 18:18:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:18:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:18:54 user nova-compute[71206]: INFO nova.compute.claims [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Claim successful on node user
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:18:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:18:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:18:55 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Creating image(s)
Jul 27 18:18:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "/opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "/opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:55 user nova-compute[71206]: DEBUG nova.policy [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '450fa830059c43e79f2cf7ca9d209d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6fa83a744c1976f04ce4c03e159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG nova.virt.images [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] 95404822-5ce2-4ee2-ac76-087d297878ad was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:18:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.part /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.part /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.converted" returned: 0 in 0.584s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.293s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e,backing_fmt=raw /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Successfully created port: 0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e,backing_fmt=raw /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk 1073741824" returned: 0 in 0.063s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "0bd6166a05f04e30f566b1fcb29c401df9ba0e8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e --force-share --output=json" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'migration_context' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Ensure instance console log exists: /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:18:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Successfully updated port: 0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquired lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-changed-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing instance network info cache due to event network-changed-0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] Acquiring lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:18:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating instance_info_cache with network_info: [{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Releasing lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Instance network_info: |[{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] Acquired lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Start _get_guest_xml network_info=[{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1eb1ef96c1d8e1cdda4b613679ae5ec8',container_format='bare',created_at=2023-07-27T18:18:44Z,direct_url=<?>,disk_format='qcow2',id=95404822-5ce2-4ee2-ac76-087d297878ad,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-617182886',owner='090bd6fa83a744c1976f04ce4c03e159',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T18:18:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '95404822-5ce2-4ee2-ac76-087d297878ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:19:00 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:00 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1eb1ef96c1d8e1cdda4b613679ae5ec8',container_format='bare',created_at=2023-07-27T18:18:44Z,direct_url=<?>,disk_format='qcow2',id=95404822-5ce2-4ee2-ac76-087d297878ad,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-617182886',owner='090bd6fa83a744c1976f04ce4c03e159',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T18:18:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-69542338',display_name='tempest-TestStampPattern-server-69542338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-69542338',id=39,image_ref='95404822-5ce2-4ee2-ac76-087d297878ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-b4ay0h6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='74f56d44-bada-4942-b47d-a0312ce2dc97',image_min_disk='1',image_min_ram='0',image_owner_id='090bd6fa83a744c1976f04ce4c03e159',image_owner_project_name='tempest-TestStampPattern-685676605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-685676605-project-member',image_user_id='450fa830059c43e79f2cf7ca9d209d76',network_allocated='True',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:18:55Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=a9ee747d-0e26-4db1-be46-b31318ffa30d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.objects.instance [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'pci_devices' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:19:00 user nova-compute[71206]:   <uuid>a9ee747d-0e26-4db1-be46-b31318ffa30d</uuid>
Jul 27 18:19:00 user nova-compute[71206]:   <name>instance-00000027</name>
Jul 27 18:19:00 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:19:00 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:19:00 user nova-compute[71206]:   <metadata>
Jul 27 18:19:00 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:19:00 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:name>tempest-TestStampPattern-server-69542338</nova:name>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:19:00</nova:creationTime>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:19:00 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:19:00 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:owner>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:user uuid="450fa830059c43e79f2cf7ca9d209d76">tempest-TestStampPattern-685676605-project-member</nova:user>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:project uuid="090bd6fa83a744c1976f04ce4c03e159">tempest-TestStampPattern-685676605</nova:project>
Jul 27 18:19:00 user nova-compute[71206]:       </nova:owner>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:root type="image" uuid="95404822-5ce2-4ee2-ac76-087d297878ad"/>
Jul 27 18:19:00 user nova-compute[71206]:       <nova:ports>
Jul 27 18:19:00 user nova-compute[71206]:         <nova:port uuid="0b27c06c-e847-4244-94b7-8e498529541d">
Jul 27 18:19:00 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:19:00 user nova-compute[71206]:         </nova:port>
Jul 27 18:19:00 user nova-compute[71206]:       </nova:ports>
Jul 27 18:19:00 user nova-compute[71206]:     </nova:instance>
Jul 27 18:19:00 user nova-compute[71206]:   </metadata>
Jul 27 18:19:00 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:19:00 user nova-compute[71206]:     <system>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="serial">a9ee747d-0e26-4db1-be46-b31318ffa30d</entry>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="uuid">a9ee747d-0e26-4db1-be46-b31318ffa30d</entry>
Jul 27 18:19:00 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:19:00 user nova-compute[71206]:     </system>
Jul 27 18:19:00 user nova-compute[71206]:   </sysinfo>
Jul 27 18:19:00 user nova-compute[71206]:   <os>
Jul 27 18:19:00 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:19:00 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:19:00 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:19:00 user nova-compute[71206]:   </os>
Jul 27 18:19:00 user nova-compute[71206]:   <features>
Jul 27 18:19:00 user nova-compute[71206]:     <acpi/>
Jul 27 18:19:00 user nova-compute[71206]:     <apic/>
Jul 27 18:19:00 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:19:00 user nova-compute[71206]:   </features>
Jul 27 18:19:00 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:19:00 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:19:00 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:19:00 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:19:00 user nova-compute[71206]:   </clock>
Jul 27 18:19:00 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:19:00 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:19:00 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:19:00 user nova-compute[71206]:   </cpu>
Jul 27 18:19:00 user nova-compute[71206]:   <devices>
Jul 27 18:19:00 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:19:00 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:19:00 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk"/>
Jul 27 18:19:00 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:19:00 user nova-compute[71206]:     </disk>
Jul 27 18:19:00 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:19:00 user nova-compute[71206]:       <mac address="fa:16:3e:06:f2:d7"/>
Jul 27 18:19:00 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:00 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:19:00 user nova-compute[71206]:       <target dev="tap0b27c06c-e8"/>
Jul 27 18:19:00 user nova-compute[71206]:     </interface>
Jul 27 18:19:00 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:19:00 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/console.log" append="off"/>
Jul 27 18:19:00 user nova-compute[71206]:     </serial>
Jul 27 18:19:00 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:19:00 user nova-compute[71206]:     <video>
Jul 27 18:19:00 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:00 user nova-compute[71206]:     </video>
Jul 27 18:19:00 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:19:00 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:19:00 user nova-compute[71206]:     </rng>
Jul 27 18:19:00 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:19:00 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:19:00 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:19:00 user nova-compute[71206]:     </memballoon>
Jul 27 18:19:00 user nova-compute[71206]:   </devices>
Jul 27 18:19:00 user nova-compute[71206]: </domain>
Jul 27 18:19:00 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-69542338',display_name='tempest-TestStampPattern-server-69542338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-69542338',id=39,image_ref='95404822-5ce2-4ee2-ac76-087d297878ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-b4ay0h6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='74f56d44-bada-4942-b47d-a0312ce2dc97',image_min_disk='1',image_min_ram='0',image_owner_id='090bd6fa83a744c1976f04ce4c03e159',image_owner_project_name='tempest-TestStampPattern-685676605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-685676605-project-member',image_user_id='450fa830059c43e79f2cf7ca9d209d76',network_allocated='True',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:18:55Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=a9ee747d-0e26-4db1-be46-b31318ffa30d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG os_vif [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b27c06c-e8, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b27c06c-e8, col_values=(('external_ids', {'iface-id': '0b27c06c-e847-4244-94b7-8e498529541d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:f2:d7', 'vm-uuid': 'a9ee747d-0e26-4db1-be46-b31318ffa30d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:00 user nova-compute[71206]: INFO os_vif [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8')
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No VIF found with MAC fa:16:3e:06:f2:d7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:19:00 user nova-compute[71206]: INFO nova.compute.claims [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Claim successful on node user
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updated VIF entry in instance network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG nova.network.neutron [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating instance_info_cache with network_info: [{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d00cff67-cf45-4445-aafb-f29005ffe7ee req-3fba709b-963b-48c0-a235-ba317dbfd182 service nova] Releasing lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:19:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.policy [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '618d118495f9473ea0b8b2f605b5dc1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bf2ce16ee948f7b5af721b5645ec2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:19:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Creating image(s)
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "/opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "/opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.209s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk 1073741824" returned: 0 in 0.070s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.compute.manager [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] No waiting events found dispatching network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:02 user nova-compute[71206]: WARNING nova.compute.manager [req-85300c7b-6fd9-4ee4-a4c2-313e458eb144 req-4a84bd5b-a1eb-44a2-8873-973e90fefe13 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received unexpected event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d for instance with vm_state building and task_state spawning.
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Cannot resize image /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'migration_context' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Ensure instance console log exists: /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:02 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Successfully created port: 24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Successfully updated port: 24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquired lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-changed-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Refreshing instance network info cache due to event network-changed-24be62b7-60b7-4739-9266-4e10c907e53c. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] Acquiring lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:03 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481944.199807, a9ee747d-0e26-4db1-be46-b31318ffa30d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] VM Resumed (Lifecycle Event)
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Instance spawned successfully.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481944.2001026, a9ee747d-0e26-4db1-be46-b31318ffa30d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] VM Started (Lifecycle Event)
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] No waiting events found dispatching network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:04 user nova-compute[71206]: WARNING nova.compute.manager [req-bf3e9709-9cfd-4900-afe5-6b81c30bc0d0 req-f55583f8-b0b9-4f4a-88c7-10b2ecc0f31b service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received unexpected event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d for instance with vm_state building and task_state spawning.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.neutron [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating instance_info_cache with network_info: [{"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Releasing lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Instance network_info: |[{"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] Acquired lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.neutron [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Refreshing network info cache for port 24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Start _get_guest_xml network_info=[{"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:19:04 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:04 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6032730',id=40,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGOMvfXphj7DSIMU6VKl25CrZlvSKtu3WAdX59XrTO7xskWP/ae1IlYVZRrIVClsT4YtGJcTkyRgMWCLTIj6hgXJYwx5D32BehoyaHtpFKdqBHq/Ju8q2B5VSGFMj+dQ==',key_name='tempest-keypair-1969425332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19bf2ce16ee948f7b5af721b5645ec2e',ramdisk_id='',reservation_id='r-1mkk6961',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='618d118495f9473ea0b8b2f605b5dc1a',uuid=3e5847a2-1036-49e3-b657-69476f8becce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converting VIF {"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Took 9.43 seconds to spawn the instance on the hypervisor.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:19:04 user nova-compute[71206]:   <uuid>3e5847a2-1036-49e3-b657-69476f8becce</uuid>
Jul 27 18:19:04 user nova-compute[71206]:   <name>instance-00000028</name>
Jul 27 18:19:04 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:19:04 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:19:04 user nova-compute[71206]:   <metadata>
Jul 27 18:19:04 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:19:04 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058</nova:name>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:19:04</nova:creationTime>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:19:04 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:19:04 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:owner>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:user uuid="618d118495f9473ea0b8b2f605b5dc1a">tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member</nova:user>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:project uuid="19bf2ce16ee948f7b5af721b5645ec2e">tempest-TestServerVolumeAttachScenarioOldVersion-1721484259</nova:project>
Jul 27 18:19:04 user nova-compute[71206]:       </nova:owner>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:19:04 user nova-compute[71206]:       <nova:ports>
Jul 27 18:19:04 user nova-compute[71206]:         <nova:port uuid="24be62b7-60b7-4739-9266-4e10c907e53c">
Jul 27 18:19:04 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 18:19:04 user nova-compute[71206]:         </nova:port>
Jul 27 18:19:04 user nova-compute[71206]:       </nova:ports>
Jul 27 18:19:04 user nova-compute[71206]:     </nova:instance>
Jul 27 18:19:04 user nova-compute[71206]:   </metadata>
Jul 27 18:19:04 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:19:04 user nova-compute[71206]:     <system>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="serial">3e5847a2-1036-49e3-b657-69476f8becce</entry>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="uuid">3e5847a2-1036-49e3-b657-69476f8becce</entry>
Jul 27 18:19:04 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:19:04 user nova-compute[71206]:     </system>
Jul 27 18:19:04 user nova-compute[71206]:   </sysinfo>
Jul 27 18:19:04 user nova-compute[71206]:   <os>
Jul 27 18:19:04 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:19:04 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:19:04 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:19:04 user nova-compute[71206]:   </os>
Jul 27 18:19:04 user nova-compute[71206]:   <features>
Jul 27 18:19:04 user nova-compute[71206]:     <acpi/>
Jul 27 18:19:04 user nova-compute[71206]:     <apic/>
Jul 27 18:19:04 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:19:04 user nova-compute[71206]:   </features>
Jul 27 18:19:04 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:19:04 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:19:04 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:19:04 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:19:04 user nova-compute[71206]:   </clock>
Jul 27 18:19:04 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:19:04 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:19:04 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:19:04 user nova-compute[71206]:   </cpu>
Jul 27 18:19:04 user nova-compute[71206]:   <devices>
Jul 27 18:19:04 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:19:04 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:19:04 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk"/>
Jul 27 18:19:04 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:19:04 user nova-compute[71206]:     </disk>
Jul 27 18:19:04 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:19:04 user nova-compute[71206]:       <mac address="fa:16:3e:03:18:e0"/>
Jul 27 18:19:04 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:04 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:19:04 user nova-compute[71206]:       <target dev="tap24be62b7-60"/>
Jul 27 18:19:04 user nova-compute[71206]:     </interface>
Jul 27 18:19:04 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:19:04 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/console.log" append="off"/>
Jul 27 18:19:04 user nova-compute[71206]:     </serial>
Jul 27 18:19:04 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:19:04 user nova-compute[71206]:     <video>
Jul 27 18:19:04 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:04 user nova-compute[71206]:     </video>
Jul 27 18:19:04 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:19:04 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:19:04 user nova-compute[71206]:     </rng>
Jul 27 18:19:04 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:19:04 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:19:04 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:19:04 user nova-compute[71206]:     </memballoon>
Jul 27 18:19:04 user nova-compute[71206]:   </devices>
Jul 27 18:19:04 user nova-compute[71206]: </domain>
Jul 27 18:19:04 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6032730',id=40,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGOMvfXphj7DSIMU6VKl25CrZlvSKtu3WAdX59XrTO7xskWP/ae1IlYVZRrIVClsT4YtGJcTkyRgMWCLTIj6hgXJYwx5D32BehoyaHtpFKdqBHq/Ju8q2B5VSGFMj+dQ==',key_name='tempest-keypair-1969425332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19bf2ce16ee948f7b5af721b5645ec2e',ramdisk_id='',reservation_id='r-1mkk6961',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='618d118495f9473ea0b8b2f605b5dc1a',uuid=3e5847a2-1036-49e3-b657-69476f8becce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converting VIF {"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG os_vif [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24be62b7-60, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24be62b7-60, col_values=(('external_ids', {'iface-id': '24be62b7-60b7-4739-9266-4e10c907e53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:18:e0', 'vm-uuid': '3e5847a2-1036-49e3-b657-69476f8becce'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:04 user nova-compute[71206]: INFO os_vif [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60')
Jul 27 18:19:04 user nova-compute[71206]: INFO nova.compute.manager [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Took 10.39 seconds to build instance.
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] No VIF found with MAC fa:16:3e:03:18:e0, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:19:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-0370b238-fd42-4ecd-9cbd-bf1e06208a73 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.499s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updated VIF entry in instance network info cache for port 24be62b7-60b7-4739-9266-4e10c907e53c. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating instance_info_cache with network_info: [{"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-45542ed9-5954-4296-8ffd-a0062d015c7a req-c0a185c6-431f-4e45-8ecd-99758ffafec9 service nova] Releasing lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing instance network info cache due to event network-changed-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.network.neutron [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Refreshing network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:19:06 user nova-compute[71206]: INFO nova.compute.claims [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Claim successful on node user
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] No waiting events found dispatching network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:06 user nova-compute[71206]: WARNING nova.compute.manager [req-98d43fed-c63c-4b4e-9ebf-b40c6fea89de req-7d480e36-e6d3-4809-9176-ed8136ab1b3c service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received unexpected event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c for instance with vm_state building and task_state spawning.
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:06 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:19:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:19:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Creating image(s)
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "/opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "/opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "/opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.policy [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d2a4b2e922c4e68a5c361749aafaa79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f20dedb8e44bd907a606d33f49537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.network.neutron [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updated VIF entry in instance network info cache for port 397c4c09-e7b6-4e5e-a4e6-36a03f7641ca. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG nova.network.neutron [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-daf9f61e-b3cf-4ceb-948a-560e7eda7ade req-cfe8ebc2-f673-4778-8fd0-af9c5c47b68b service nova] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.182s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk 1073741824" returned: 0 in 0.071s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.161s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-changed-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Refreshing instance network info cache due to event network-changed-67d4dbb8-05a2-4ae0-a4f6-c34557360b95. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.network.neutron [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Refreshing network info cache for port 67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Cannot resize image /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lazy-loading 'migration_context' on Instance uuid cde8dfde-fed8-4ad1-9d0f-3901d3105a33 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Ensure instance console log exists: /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] No waiting events found dispatching network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:08 user nova-compute[71206]: WARNING nova.compute.manager [req-14321755-16cf-4544-8aae-e1f6216b2d90 req-0a02f0f7-d636-48fd-aa9a-8f8ea90bd663 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received unexpected event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c for instance with vm_state building and task_state spawning.
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481948.7248747, 3e5847a2-1036-49e3-b657-69476f8becce => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] VM Resumed (Lifecycle Event)
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Instance spawned successfully.
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481948.7261858, 3e5847a2-1036-49e3-b657-69476f8becce => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] VM Started (Lifecycle Event)
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Successfully created port: 012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:08 user nova-compute[71206]: INFO nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Took 7.49 seconds to spawn the instance on the hypervisor.
Jul 27 18:19:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:09 user nova-compute[71206]: INFO nova.compute.manager [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Took 8.40 seconds to build instance.
Jul 27 18:19:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4a7ea3bb-15ee-4cef-a9ca-edcae9225469 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.556s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updated VIF entry in instance network info cache for port 67d4dbb8-05a2-4ae0-a4f6-c34557360b95. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.network.neutron [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Stashing vm_state: active {{(pid=71206) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-18ba83ae-fc93-4fc4-8aa9-cb1c622d6e38 req-257e6af5-f582-4fef-85ec-fe72700aa02b service nova] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_requests' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:19:09 user nova-compute[71206]: INFO nova.compute.claims [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Claim successful on node user
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'resources' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:09 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating resource usage from migration d9fd6f00-0891-4ad5-b19e-a8a728a15180
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.541s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:09 user nova-compute[71206]: INFO nova.compute.manager [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Migrating
Jul 27 18:19:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Successfully updated port: 012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquired lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-changed-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Refreshing instance network info cache due to event network-changed-012eaf98-ffab-4f98-b553-a1896031fa6a. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] Acquiring lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:10 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Updating instance_info_cache with network_info: [{"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Releasing lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Instance network_info: |[{"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] Acquired lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.neutron [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Refreshing network info cache for port 012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Start _get_guest_xml network_info=[{"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:19:11 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:11 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2067773294',display_name='tempest-VolumesNegativeTest-instance-2067773294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2067773294',id=41,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c0f20dedb8e44bd907a606d33f49537',ramdisk_id='',reservation_id='r-uudz0748',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1606252313',owner_user_name='tempest-VolumesNegativeTest-1606252313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:07Z,user_data=None,user_id='5d2a4b2e922c4e68a5c361749aafaa79',uuid=cde8dfde-fed8-4ad1-9d0f-3901d3105a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converting VIF {"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lazy-loading 'pci_devices' on Instance uuid cde8dfde-fed8-4ad1-9d0f-3901d3105a33 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:19:11 user nova-compute[71206]:   <uuid>cde8dfde-fed8-4ad1-9d0f-3901d3105a33</uuid>
Jul 27 18:19:11 user nova-compute[71206]:   <name>instance-00000029</name>
Jul 27 18:19:11 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:19:11 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:19:11 user nova-compute[71206]:   <metadata>
Jul 27 18:19:11 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:19:11 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:name>tempest-VolumesNegativeTest-instance-2067773294</nova:name>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:19:11</nova:creationTime>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:19:11 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:19:11 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:owner>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:user uuid="5d2a4b2e922c4e68a5c361749aafaa79">tempest-VolumesNegativeTest-1606252313-project-member</nova:user>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:project uuid="3c0f20dedb8e44bd907a606d33f49537">tempest-VolumesNegativeTest-1606252313</nova:project>
Jul 27 18:19:11 user nova-compute[71206]:       </nova:owner>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:19:11 user nova-compute[71206]:       <nova:ports>
Jul 27 18:19:11 user nova-compute[71206]:         <nova:port uuid="012eaf98-ffab-4f98-b553-a1896031fa6a">
Jul 27 18:19:11 user nova-compute[71206]:           <nova:ip type="fixed" address="192.168.233.207" ipVersion="4"/>
Jul 27 18:19:11 user nova-compute[71206]:         </nova:port>
Jul 27 18:19:11 user nova-compute[71206]:       </nova:ports>
Jul 27 18:19:11 user nova-compute[71206]:     </nova:instance>
Jul 27 18:19:11 user nova-compute[71206]:   </metadata>
Jul 27 18:19:11 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:19:11 user nova-compute[71206]:     <system>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="serial">cde8dfde-fed8-4ad1-9d0f-3901d3105a33</entry>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="uuid">cde8dfde-fed8-4ad1-9d0f-3901d3105a33</entry>
Jul 27 18:19:11 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:19:11 user nova-compute[71206]:     </system>
Jul 27 18:19:11 user nova-compute[71206]:   </sysinfo>
Jul 27 18:19:11 user nova-compute[71206]:   <os>
Jul 27 18:19:11 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:19:11 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:19:11 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:19:11 user nova-compute[71206]:   </os>
Jul 27 18:19:11 user nova-compute[71206]:   <features>
Jul 27 18:19:11 user nova-compute[71206]:     <acpi/>
Jul 27 18:19:11 user nova-compute[71206]:     <apic/>
Jul 27 18:19:11 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:19:11 user nova-compute[71206]:   </features>
Jul 27 18:19:11 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:19:11 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:19:11 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:19:11 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:19:11 user nova-compute[71206]:   </clock>
Jul 27 18:19:11 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:19:11 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:19:11 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:19:11 user nova-compute[71206]:   </cpu>
Jul 27 18:19:11 user nova-compute[71206]:   <devices>
Jul 27 18:19:11 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:19:11 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:19:11 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk"/>
Jul 27 18:19:11 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:19:11 user nova-compute[71206]:     </disk>
Jul 27 18:19:11 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:19:11 user nova-compute[71206]:       <mac address="fa:16:3e:77:1f:20"/>
Jul 27 18:19:11 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:11 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:19:11 user nova-compute[71206]:       <target dev="tap012eaf98-ff"/>
Jul 27 18:19:11 user nova-compute[71206]:     </interface>
Jul 27 18:19:11 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:19:11 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/console.log" append="off"/>
Jul 27 18:19:11 user nova-compute[71206]:     </serial>
Jul 27 18:19:11 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:19:11 user nova-compute[71206]:     <video>
Jul 27 18:19:11 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:11 user nova-compute[71206]:     </video>
Jul 27 18:19:11 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:19:11 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:19:11 user nova-compute[71206]:     </rng>
Jul 27 18:19:11 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:19:11 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:19:11 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:19:11 user nova-compute[71206]:     </memballoon>
Jul 27 18:19:11 user nova-compute[71206]:   </devices>
Jul 27 18:19:11 user nova-compute[71206]: </domain>
Jul 27 18:19:11 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2067773294',display_name='tempest-VolumesNegativeTest-instance-2067773294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2067773294',id=41,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c0f20dedb8e44bd907a606d33f49537',ramdisk_id='',reservation_id='r-uudz0748',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1606252313',owner_user_name='tempest-VolumesNegativeTest-1606252313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:07Z,user_data=None,user_id='5d2a4b2e922c4e68a5c361749aafaa79',uuid=cde8dfde-fed8-4ad1-9d0f-3901d3105a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converting VIF {"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG os_vif [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap012eaf98-ff, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap012eaf98-ff, col_values=(('external_ids', {'iface-id': '012eaf98-ffab-4f98-b553-a1896031fa6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:1f:20', 'vm-uuid': 'cde8dfde-fed8-4ad1-9d0f-3901d3105a33'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: INFO os_vif [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff')
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] No VIF found with MAC fa:16:3e:77:1f:20, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Starting migrate_disk_and_power_off {{(pid=71206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Updated VIF entry in instance network info cache for port 012eaf98-ffab-4f98-b553-a1896031fa6a. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.network.neutron [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Updating instance_info_cache with network_info: [{"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbd99c40-ac69-43ac-bb9c-6e5c7c180ae7 req-bfec4e92-05a0-414a-b53c-b3d300e1d88e service nova] Releasing lock "refresh_cache-cde8dfde-fed8-4ad1-9d0f-3901d3105a33" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:12 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance destroyed successfully.
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d4dbb8-05, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:12 user nova-compute[71206]: INFO os_vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05')
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:12 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[613f1c90-812c-4f8b-99bc-894734c5ee9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:19:12 user nova-compute[71206]: No targets found.
Jul 27 18:19:12 user nova-compute[71206]: iSNS:
Jul 27 18:19:12 user nova-compute[71206]: No targets found.
Jul 27 18:19:12 user nova-compute[71206]: STATIC:
Jul 27 18:19:12 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b
Jul 27 18:19:12 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:12 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:12 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:19:12 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:12 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:12 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:19:12 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:12 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:12 user nova-compute[71206]: FIRMWARE:
Jul 27 18:19:12 user nova-compute[71206]: No targets found.
Jul 27 18:19:12 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:19:12 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:19:12 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3d216a-ebb3-427b-9cac-4af01731d24d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1431011-b877-4332-9a4c-74328ca0e41e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:12 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:12 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:12 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:12 user nova-compute[71206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:12 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:12 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c3c5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e40d9-32ba-487a-971b-94eb588820ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c3d855-e220-45a8-a6d7-9898ff2189dd]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[962de505-c16b-4d5f-b90e-48af3d3454ed]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.077s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0663bad-3bc6-4091-a0a0-a67093c841ef]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efcea5e-4b9f-4ecc-b2ad-f120819f9a6e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG nova.compute.manager [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:12 user nova-compute[71206]: WARNING nova.compute.manager [req-5330ffef-636e-4f95-9eb0-2c3e5dbaf837 req-bcf465d6-443c-4bb8-8f4d-93fbf7799786 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state resize_migrating.
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.127s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4165c8-5754-46ed-8d9d-a7e280ea4643]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]
Jul 27 18:19:12 user nova-compute[71206]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.
Jul 27 18:19:12 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:12 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e9f91-8877-425d-b1e8-de1c180744cc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.510s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== disconnect_volume: return (513ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Port 67d4dbb8-05a2-4ae0-a4f6-c34557360b95 binding to destination host user is already ACTIVE {{(pid=71206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:15 user nova-compute[71206]: WARNING nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state resize_migrated.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] No waiting events found dispatching network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:15 user nova-compute[71206]: WARNING nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received unexpected event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a for instance with vm_state building and task_state spawning.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] No waiting events found dispatching network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:15 user nova-compute[71206]: WARNING nova.compute.manager [req-3829748f-6c28-4109-9823-9dfa0ddaae13 req-d9549136-5d32-4bdf-9200-7e4eaf6f4f07 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received unexpected event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a for instance with vm_state building and task_state spawning.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.compute.manager [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Terminating instance
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-unplugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] No waiting events found dispatching network-vif-unplugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [req-c80977e4-349a-4194-91e8-c6c32e296369 req-fb7be569-44bd-4883-a8bc-8ae4bdc846a3 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-unplugged-e4c67d3e-88fe-445f-83c8-b25fced5471d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.network.neutron [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481955.8499756, cde8dfde-fed8-4ad1-9d0f-3901d3105a33 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] VM Resumed (Lifecycle Event)
Jul 27 18:19:15 user nova-compute[71206]: DEBUG os_brick.utils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Instance spawned successfully.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1384c4d-a332-4dfe-8ac9-7de9b46f423a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6bd35d-9ada-4cff-a1f8-d62de9b9c890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Instance destroyed successfully.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lazy-loading 'resources' on Instance uuid e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481955.8502848, cde8dfde-fed8-4ad1-9d0f-3901d3105a33 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:15 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] VM Started (Lifecycle Event)
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114b1e8-596c-44fc-b9c2-954050909018]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931170830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931170830',id=2,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a72bcdbc35df444c99f3d4045832c9a8',ramdisk_id='',reservation_id='r-2ft8kh0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:01:32Z,user_data=None,user_id='0ed5535b566e42f195aebce82e14ced7',uuid=e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converting VIF {"id": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "address": "fa:16:3e:c1:20:57", "network": {"id": "c6a1e057-4629-4062-b634-25dc15587dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-183053770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a72bcdbc35df444c99f3d4045832c9a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c67d3e-88", "ovs_interfaceid": "e4c67d3e-88fe-445f-83c8-b25fced5471d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG os_vif [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:19:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291bd29-1ed4-4827-9690-054cb90bcc55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4c67d3e-88, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Took 8.68 seconds to spawn the instance on the hypervisor.
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:16 user nova-compute[71206]: INFO os_vif [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:20:57,bridge_name='br-int',has_traffic_filtering=True,id=e4c67d3e-88fe-445f-83c8-b25fced5471d,network=Network(c6a1e057-4629-4062-b634-25dc15587dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c67d3e-88')
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Deleting instance files /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f_del
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Deletion of /opt/stack/data/nova/instances/e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f_del complete
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:19:16 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bcfe39-fb2f-4e32-934a-a5d1d6e9232b]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG os_brick.utils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== get_connector_properties: return (230ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.compute.manager [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.compute.manager [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Took 9.83 seconds to build instance.
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6dac9a43-b2d3-4fd8-9337-70c0ba4224f4 tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.026s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:16 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Took 0.73 seconds to deallocate network for instance.
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:16 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-949833dc-ea8c-44fa-9ac2-d0023e3d916f req-1c495eaf-edd8-48da-b52b-185423ef3291 service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-deleted-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:17 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Deleted allocations for instance e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f
Jul 27 18:19:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-59d29c5c-8db8-46a6-a0a3-78e58ab357a1 tempest-ServerBootFromVolumeStableRescueTest-1231153209 tempest-ServerBootFromVolumeStableRescueTest-1231153209-project-member] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] Acquiring lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] Lock "e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] No waiting events found dispatching network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:17 user nova-compute[71206]: WARNING nova.compute.manager [req-d93d2d10-06a4-474d-a5c9-408aa7ceb0c0 req-09d13235-7e29-4a7b-a77d-d5c44d6c1d7b service nova] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Received unexpected event network-vif-plugged-e4c67d3e-88fe-445f-83c8-b25fced5471d for instance with vm_state deleted and task_state None.
Jul 27 18:19:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:19:19 user nova-compute[71206]: INFO nova.compute.claims [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Claim successful on node user
Jul 27 18:19:19 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:19:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.policy [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '671f2aec0ab2455cb24e10f5c726ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a70697714134b96873b86f84ef10ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:19:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Creating image(s)
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "c5835b3308b1322d17550437233cd08f78d7df28" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "c5835b3308b1322d17550437233cd08f78d7df28" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.part --force-share --output=json" returned: 0 in 0.176s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG nova.virt.images [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] e4fd959f-93e5-4b84-b0c6-ce0307c9a366 was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.part /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Successfully created port: 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.part /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.converted" returned: 0 in 0.382s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "c5835b3308b1322d17550437233cd08f78d7df28" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.583s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json" returned: 0 in 0.230s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "c5835b3308b1322d17550437233cd08f78d7df28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "c5835b3308b1322d17550437233cd08f78d7df28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json" returned: 0 in 0.179s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28,backing_fmt=raw /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28,backing_fmt=raw /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk 1073741824" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "c5835b3308b1322d17550437233cd08f78d7df28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Successfully updated port: 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-changed-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing instance network info cache due to event network-changed-36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Cannot resize image /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'migration_context' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Ensure instance console log exists: /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9b0e8048-413a-4f14-bbcb-8a7f8119d7ed req-90c42614-ed53-4992-ae49-a516769950f5 service nova] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.network.neutron [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance network_info: |[{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start _get_guest_xml network_info=[{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:19:15Z,direct_url=<?>,disk_format='qcow2',id=e4fd959f-93e5-4b84-b0c6-ce0307c9a366,min_disk=0,min_ram=0,name='tempest-scenario-img--191757464',owner='2a70697714134b96873b86f84ef10ffc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:19:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'e4fd959f-93e5-4b84-b0c6-ce0307c9a366'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:19:23 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:23 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:19:15Z,direct_url=<?>,disk_format='qcow2',id=e4fd959f-93e5-4b84-b0c6-ce0307c9a366,min_disk=0,min_ram=0,name='tempest-scenario-img--191757464',owner='2a70697714134b96873b86f84ef10ffc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:19:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:20Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'pci_devices' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:19:23 user nova-compute[71206]:   <uuid>f606f8e4-7da8-4d29-9098-245d114cec8b</uuid>
Jul 27 18:19:23 user nova-compute[71206]:   <name>instance-0000002a</name>
Jul 27 18:19:23 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:19:23 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:19:23 user nova-compute[71206]:   <metadata>
Jul 27 18:19:23 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:19:23 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:name>tempest-TestMinimumBasicScenario-server-488649459</nova:name>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:19:23</nova:creationTime>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:19:23 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:19:23 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:owner>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:user uuid="671f2aec0ab2455cb24e10f5c726ecbb">tempest-TestMinimumBasicScenario-197547931-project-member</nova:user>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:project uuid="2a70697714134b96873b86f84ef10ffc">tempest-TestMinimumBasicScenario-197547931</nova:project>
Jul 27 18:19:23 user nova-compute[71206]:       </nova:owner>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:root type="image" uuid="e4fd959f-93e5-4b84-b0c6-ce0307c9a366"/>
Jul 27 18:19:23 user nova-compute[71206]:       <nova:ports>
Jul 27 18:19:23 user nova-compute[71206]:         <nova:port uuid="36e87352-0e48-4211-9bdc-783431f2215b">
Jul 27 18:19:23 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:19:23 user nova-compute[71206]:         </nova:port>
Jul 27 18:19:23 user nova-compute[71206]:       </nova:ports>
Jul 27 18:19:23 user nova-compute[71206]:     </nova:instance>
Jul 27 18:19:23 user nova-compute[71206]:   </metadata>
Jul 27 18:19:23 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:19:23 user nova-compute[71206]:     <system>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="serial">f606f8e4-7da8-4d29-9098-245d114cec8b</entry>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="uuid">f606f8e4-7da8-4d29-9098-245d114cec8b</entry>
Jul 27 18:19:23 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:19:23 user nova-compute[71206]:     </system>
Jul 27 18:19:23 user nova-compute[71206]:   </sysinfo>
Jul 27 18:19:23 user nova-compute[71206]:   <os>
Jul 27 18:19:23 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:19:23 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:19:23 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:19:23 user nova-compute[71206]:   </os>
Jul 27 18:19:23 user nova-compute[71206]:   <features>
Jul 27 18:19:23 user nova-compute[71206]:     <acpi/>
Jul 27 18:19:23 user nova-compute[71206]:     <apic/>
Jul 27 18:19:23 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:19:23 user nova-compute[71206]:   </features>
Jul 27 18:19:23 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:19:23 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:19:23 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:19:23 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:19:23 user nova-compute[71206]:   </clock>
Jul 27 18:19:23 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:19:23 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:19:23 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:19:23 user nova-compute[71206]:   </cpu>
Jul 27 18:19:23 user nova-compute[71206]:   <devices>
Jul 27 18:19:23 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:19:23 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:19:23 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk"/>
Jul 27 18:19:23 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:19:23 user nova-compute[71206]:     </disk>
Jul 27 18:19:23 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:19:23 user nova-compute[71206]:       <mac address="fa:16:3e:c9:de:8f"/>
Jul 27 18:19:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:23 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:19:23 user nova-compute[71206]:       <target dev="tap36e87352-0e"/>
Jul 27 18:19:23 user nova-compute[71206]:     </interface>
Jul 27 18:19:23 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:19:23 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/console.log" append="off"/>
Jul 27 18:19:23 user nova-compute[71206]:     </serial>
Jul 27 18:19:23 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:19:23 user nova-compute[71206]:     <video>
Jul 27 18:19:23 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:23 user nova-compute[71206]:     </video>
Jul 27 18:19:23 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:19:23 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:19:23 user nova-compute[71206]:     </rng>
Jul 27 18:19:23 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:19:23 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:19:23 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:19:23 user nova-compute[71206]:     </memballoon>
Jul 27 18:19:23 user nova-compute[71206]:   </devices>
Jul 27 18:19:23 user nova-compute[71206]: </domain>
Jul 27 18:19:23 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:20Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG os_vif [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36e87352-0e, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36e87352-0e, col_values=(('external_ids', {'iface-id': '36e87352-0e48-4211-9bdc-783431f2215b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:de:8f', 'vm-uuid': 'f606f8e4-7da8-4d29-9098-245d114cec8b'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:23 user nova-compute[71206]: INFO os_vif [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e')
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:19:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No VIF found with MAC fa:16:3e:c9:de:8f, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Starting finish_migration {{(pid=71206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance directory exists: not creating {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 18:19:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Creating image(s)
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Ensure instance console log exists: /opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start _get_guest_xml network_info=[{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '579039c2-9b53-4706-a05c-3837fbcca832', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0f64c63f-3a78-4f85-87d3-33590f43b5fb', 'attached_at': '2023-07-27T18:19:24.000000', 'detached_at': '', 'volume_id': 'ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'serial': 'ef8afa97-c884-4c6f-9659-aa4551aa79d0'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:19:24 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:24 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:19:24 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:19:24 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e6f925-8561-4ece-a65b-a5ddc83f5dc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:19:24 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb3958-53db-45c8-b981-91307573b273]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0] added
Jul 27 18:19:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c073b-33d4-41b1-b242-546e15bf8443]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.066s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2eb6a5-352a-4ab3-b596-f064b50e8c2b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHpjnoGh {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHpjnoGh" returned: 0 in 0.034s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929cff2-5f06-42de-ab2d-792b78bde3d2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHpjnoGh'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b805a6-2b80-4568-aa58-2810547346c9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4971dfa1-ef7f-411f-8268-0c79896c112e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:24 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:24 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:24 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: INFO nova.compute.manager [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Detaching volume 1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: INFO nova.virt.block_device [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Attempting to driver detach volume 1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b from mountpoint /dev/vdb
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Attempting to detach device vdb from instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:19:25 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:19:25 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:19:25 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:19:25 user nova-compute[71206]:   <serial>1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b</serial>
Jul 27 18:19:25 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:19:25 user nova-compute[71206]: </disk>
Jul 27 18:19:25 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:19:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully detached device vdb from instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 from the persistent domain config.
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:19:25 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:19:25 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:19:25 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:19:25 user nova-compute[71206]:   <serial>1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b</serial>
Jul 27 18:19:25 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:19:25 user nova-compute[71206]: </disk>
Jul 27 18:19:25 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:25 user nova-compute[71206]: WARNING nova.compute.manager [req-af5009b2-a0aa-4654-a2e2-ef6db079d9cf req-1c05b54c-4f26-4e27-be9e-849739fe86e8 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state building and task_state spawning.
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --login" returned: 0 in 1.068s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b00cbf-c331-41d7-8fff-ff3f77dbaf5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]
Jul 27 18:19:25 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.
Jul 27 18:19:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56e0112-9394-4759-80ca-e9bc504f223b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd50f7-4330-4994-8780-4ab55c87e0e8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:25 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:25 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:25 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:25 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.437s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690481965.6951728, 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:19:25 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully detached device vdb from instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 from the live domain config.
Jul 27 18:19:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWmdoYKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa73ab-0caf-4b5f-9d68-7433f925d189]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:19:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.468s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== connect_volume: return (2470ms) {'type': 'block', 'scsi_wwn': '23365373137316661', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365373137316661', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.017s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e94c916-31c5-4b3b-90cb-eabce0313707]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:19:26 user nova-compute[71206]: No targets found.
Jul 27 18:19:26 user nova-compute[71206]: iSNS:
Jul 27 18:19:26 user nova-compute[71206]: No targets found.
Jul 27 18:19:26 user nova-compute[71206]: STATIC:
Jul 27 18:19:26 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b
Jul 27 18:19:26 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:26 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:26 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:19:26 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:26 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:26 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:19:26 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:26 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:26 user nova-compute[71206]: FIRMWARE:
Jul 27 18:19:26 user nova-compute[71206]: No targets found.
Jul 27 18:19:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:19:26 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:19:26 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:19:26 user nova-compute[71206]:   <uuid>0f64c63f-3a78-4f85-87d3-33590f43b5fb</uuid>
Jul 27 18:19:26 user nova-compute[71206]:   <name>instance-00000025</name>
Jul 27 18:19:26 user nova-compute[71206]:   <memory>2097152</memory>
Jul 27 18:19:26 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:19:26 user nova-compute[71206]:   <metadata>
Jul 27 18:19:26 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:19:26 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:19:26 user nova-compute[71206]:       <nova:name>tempest-ServerActionsTestOtherA-server-346661414</nova:name>
Jul 27 18:19:26 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:19:24</nova:creationTime>
Jul 27 18:19:26 user nova-compute[71206]:       <nova:flavor name="m1.small">
Jul 27 18:19:26 user nova-compute[71206]:         <nova:memory>2048</nova:memory>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:disk>20</nova:disk>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:19:26 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:19:26 user nova-compute[71206]:       <nova:owner>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:user uuid="8c1d017cd91d4121b90577b54b28fd89">tempest-ServerActionsTestOtherA-543896870-project-member</nova:user>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:project uuid="4785a59769df4f2b8e1a027469d25d79">tempest-ServerActionsTestOtherA-543896870</nova:project>
Jul 27 18:19:26 user nova-compute[71206]:       </nova:owner>
Jul 27 18:19:26 user nova-compute[71206]:       <nova:ports>
Jul 27 18:19:26 user nova-compute[71206]:         <nova:port uuid="67d4dbb8-05a2-4ae0-a4f6-c34557360b95">
Jul 27 18:19:26 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:19:26 user nova-compute[71206]:         </nova:port>
Jul 27 18:19:26 user nova-compute[71206]:       </nova:ports>
Jul 27 18:19:26 user nova-compute[71206]:     </nova:instance>
Jul 27 18:19:26 user nova-compute[71206]:   </metadata>
Jul 27 18:19:26 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:19:26 user nova-compute[71206]:     <system>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="serial">0f64c63f-3a78-4f85-87d3-33590f43b5fb</entry>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="uuid">0f64c63f-3a78-4f85-87d3-33590f43b5fb</entry>
Jul 27 18:19:26 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:19:26 user nova-compute[71206]:     </system>
Jul 27 18:19:26 user nova-compute[71206]:   </sysinfo>
Jul 27 18:19:26 user nova-compute[71206]:   <os>
Jul 27 18:19:26 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:19:26 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:19:26 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:19:26 user nova-compute[71206]:   </os>
Jul 27 18:19:26 user nova-compute[71206]:   <features>
Jul 27 18:19:26 user nova-compute[71206]:     <acpi/>
Jul 27 18:19:26 user nova-compute[71206]:     <apic/>
Jul 27 18:19:26 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:19:26 user nova-compute[71206]:   </features>
Jul 27 18:19:26 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:19:26 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:19:26 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:19:26 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:19:26 user nova-compute[71206]:   </clock>
Jul 27 18:19:26 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:19:26 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:19:26 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:19:26 user nova-compute[71206]:   </cpu>
Jul 27 18:19:26 user nova-compute[71206]:   <devices>
Jul 27 18:19:26 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:19:26 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:19:26 user nova-compute[71206]:       <source dev="/dev/sdc"/>
Jul 27 18:19:26 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:19:26 user nova-compute[71206]:       <serial>ef8afa97-c884-4c6f-9659-aa4551aa79d0</serial>
Jul 27 18:19:26 user nova-compute[71206]:     </disk>
Jul 27 18:19:26 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:19:26 user nova-compute[71206]:       <mac address="fa:16:3e:4c:6c:85"/>
Jul 27 18:19:26 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:26 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:19:26 user nova-compute[71206]:       <target dev="tap67d4dbb8-05"/>
Jul 27 18:19:26 user nova-compute[71206]:     </interface>
Jul 27 18:19:26 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:19:26 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb/console.log" append="off"/>
Jul 27 18:19:26 user nova-compute[71206]:     </serial>
Jul 27 18:19:26 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:19:26 user nova-compute[71206]:     <video>
Jul 27 18:19:26 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:19:26 user nova-compute[71206]:     </video>
Jul 27 18:19:26 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:19:26 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:19:26 user nova-compute[71206]:     </rng>
Jul 27 18:19:26 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:19:26 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:19:26 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:19:26 user nova-compute[71206]:     </memballoon>
Jul 27 18:19:26 user nova-compute[71206]:   </devices>
Jul 27 18:19:26 user nova-compute[71206]: </domain>
Jul 27 18:19:26 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-206330169-network", "vif_mac": "fa:16:3e:4c:6c:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d4dbb8-05, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67d4dbb8-05, col_values=(('external_ids', {'iface-id': '67d4dbb8-05a2-4ae0-a4f6-c34557360b95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:6c:85', 'vm-uuid': '0f64c63f-3a78-4f85-87d3-33590f43b5fb'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4c6af-09c4-4dbd-9964-4591b683aa44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:26 user nova-compute[71206]: INFO os_vif [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05')
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e938a6-6fe8-4870-ad87-e30cdf0904d9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:26 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:26 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:26 user nova-compute[71206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b (non-flash)
Jul 27 18:19:26 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:26 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c505f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b78f7-0932-467a-b97f-053b50516435]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d824400d-d2bc-45be-a2f3-598fca306f80]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] No VIF found with MAC fa:16:3e:4c:6c:85, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0666784-9560-41e9-9479-27f85e3ad222]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fbeb10-d003-4013-8aa5-189cbf8bb89e]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452e288-71a1-4f37-a810-1b97ac92822b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.172s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d7bea-2c00-4888-8fbd-6b78eab98a05]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260]
Jul 27 18:19:27 user nova-compute[71206]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b, portal: 172.16.0.220,3260] successful.
Jul 27 18:19:27 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f5dce-91f4-4b0e-9a41-37617580470a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== disconnect_volume: return (1458ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481952.4352283, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Stopped (Lifecycle Event)
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:27 user nova-compute[71206]: WARNING nova.compute.manager [req-290ddec6-4121-4b24-a6d3-c7343e4dc0c7 req-ef0f5c1a-4466-4aac-87b7-88e4a16a9d84 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state building and task_state spawning.
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fa0fa360-a5fa-4683-aa31-5fbcd359dac0 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481967.6073263, f606f8e4-7da8-4d29-9098-245d114cec8b => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] VM Resumed (Lifecycle Event)
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance spawned successfully.
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481967.6180224, f606f8e4-7da8-4d29-9098-245d114cec8b => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] VM Started (Lifecycle Event)
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Took 7.51 seconds to spawn the instance on the hypervisor.
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:19:27 user nova-compute[71206]: INFO nova.compute.manager [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Took 8.41 seconds to build instance.
Jul 27 18:19:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-fc7c4518-dd07-48af-8292-832bec9537e5 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.547s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:27 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f15cf0a3-134a-4c39-8425-25ed8e49129d tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.047s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.905s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:28 user nova-compute[71206]: INFO nova.compute.manager [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Terminating instance
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:28 user nova-compute[71206]: WARNING nova.compute.manager [req-fc1fdca2-3938-4ca3-aa6d-11b3cd868fe8 req-931df88d-c7bf-440d-b0f7-508ef7819641 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state resize_finish.
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Instance destroyed successfully.
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'resources' on Instance uuid 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-176474161',display_name='tempest-VolumesSnapshotTestJSON-instance-176474161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-176474161',id=36,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEETq/hETJi1bM3P7KJJIRJfLS1nWG/PVspW4nc96dkER5Lho7FB7QWWpmdgxTZO/jT5QfxnrNgzdRYB4cih7IMbuDqKTVeyCu0/Mi+vgrtisNWw9lKpFXmc8WGq14sTHg==',key_name='tempest-keypair-1539667029',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:16:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-n0qexkwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "address": "fa:16:3e:e2:cc:8d", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5a89dd-aa", "ovs_interfaceid": "cf5a89dd-aa4a-4b0a-8921-82982a371052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG os_vif [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5a89dd-aa, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:28 user nova-compute[71206]: INFO os_vif [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cc:8d,bridge_name='br-int',has_traffic_filtering=True,id=cf5a89dd-aa4a-4b0a-8921-82982a371052,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5a89dd-aa')
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWmdoYKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:29 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad9831-c953-44ee-948c-732516991af2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:19:29 user nova-compute[71206]: No targets found.
Jul 27 18:19:29 user nova-compute[71206]: iSNS:
Jul 27 18:19:29 user nova-compute[71206]: No targets found.
Jul 27 18:19:29 user nova-compute[71206]: STATIC:
Jul 27 18:19:29 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:19:29 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:29 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:29 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:19:29 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:19:29 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:19:29 user nova-compute[71206]: FIRMWARE:
Jul 27 18:19:29 user nova-compute[71206]: No targets found.
Jul 27 18:19:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:19:29 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:19:29 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b052bed-b6c6-4d9b-ac2d-0aaa6b448b9b', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c81aa3-0bc9-472c-81cf-720f370e7448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e0283-afaf-49ae-9607-2d12401ad370]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:29 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:19:29 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:19:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c50db40>, {}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Disconnecting from: [] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== disconnect_volume: return (83ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:19:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Deleting instance files /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5_del
Jul 27 18:19:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Deletion of /opt/stack/data/nova/instances/7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5_del complete
Jul 27 18:19:29 user nova-compute[71206]: INFO nova.compute.manager [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Took 1.13 seconds to destroy the instance on the hypervisor.
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-unplugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] No waiting events found dispatching network-vif-unplugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-unplugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Acquiring lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] No waiting events found dispatching network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:29 user nova-compute[71206]: WARNING nova.compute.manager [req-da1ca6ca-96fd-459d-95ec-a86640ff6b16 req-f27a8409-5cce-47b6-a4e4-dde0bc35ed43 service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received unexpected event network-vif-plugged-cf5a89dd-aa4a-4b0a-8921-82982a371052 for instance with vm_state active and task_state deleting.
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:30 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Took 1.02 seconds to deallocate network for instance.
Jul 27 18:19:30 user nova-compute[71206]: WARNING nova.volume.cinder [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Attachment 265b69f0-37fe-4362-9ad0-4d4dc9c29efa does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 265b69f0-37fe-4362-9ad0-4d4dc9c29efa. (HTTP 404) (Request-ID: req-c6eafae2-de06-4787-89b1-8cb1b77e73b0)
Jul 27 18:19:30 user nova-compute[71206]: INFO nova.compute.manager [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Took 0.04 seconds to detach 1 volumes for instance.
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:19:30 user nova-compute[71206]: WARNING nova.compute.manager [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state resize_finish.
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-11e157a3-5e9c-48c9-b037-cebf81533232 req-81bc130c-f2ef-43a4-a6c0-aab337f4641c service nova] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Received event network-vif-deleted-cf5a89dd-aa4a-4b0a-8921-82982a371052 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:30 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Deleted allocations for instance 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5
Jul 27 18:19:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5890055c-6f35-4120-98de-b08c75d6eb6c tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481971.002593, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Resumed (Lifecycle Event)
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance running successfully.
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Failed to set time: agent not configured {{(pid=71206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7d630ef8-449b-4cfc-920e-7bbab14a5f20 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] finish_migration finished successfully. {{(pid=71206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690481971.0087922, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Started (Lifecycle Event)
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481955.9249842, e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:31 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] VM Stopped (Lifecycle Event)
Jul 27 18:19:31 user nova-compute[71206]: DEBUG nova.compute.manager [None req-af809be8-873e-42f4-aa15-83649a11c1d3 None None] [instance: e20ec8f6-9f71-4fe9-9ec4-f11b7afc1b9f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:37 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:39 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:19:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=25.20699691772461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Applying migration context for instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb as it has an incoming, in-progress migration d9fd6f00-0891-4ad5-b19e-a8a728a15180. Migration status is finished {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 18:19:42 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating resource usage from migration d9fd6f00-0891-4ad5-b19e-a8a728a15180
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7a3a1a62-0246-475c-b346-35aab836bf84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a9ee747d-0e26-4db1-be46-b31318ffa30d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3e5847a2-1036-49e3-b657-69476f8becce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance cde8dfde-fed8-4ad1-9d0f-3901d3105a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Migration d9fd6f00-0891-4ad5-b19e-a8a728a15180 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f606f8e4-7da8-4d29-9098-245d114cec8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing instance network info cache due to event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] Acquiring lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] Acquired lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690481968.951095, 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:19:43 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] VM Stopped (Lifecycle Event)
Jul 27 18:19:43 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d2bb16f8-cc7f-4607-b7da-ed9a1fcbbc3a None None] [instance: 7f1b2d58-b65c-44a8-bbc5-a13f9b6280d5] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:19:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:44 user nova-compute[71206]: DEBUG nova.network.neutron [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updated VIF entry in instance network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:44 user nova-compute[71206]: DEBUG nova.network.neutron [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating instance_info_cache with network_info: [{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-589a0673-4035-4fe0-af23-24f697fe5934 req-da0abe1a-9577-41e4-97ec-1ffd47ae9af2 service nova] Releasing lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:19:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:19:55 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:19:55 user nova-compute[71206]: INFO nova.compute.claims [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Claim successful on node user
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:19:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:19:56 user nova-compute[71206]: INFO nova.virt.block_device [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Booting with volume 33b303b2-b8d3-43d3-9186-87fb0dfb442f at /dev/vda
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.policy [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27abded262da493aa617c1c4b3fc86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea22847821f4d6d9a2a6b127ee5ce6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98917d1-003d-4cae-9561-e45d30b04f64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2851b5b-136d-4b0e-90b1-a5784bdca3ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd01c96-3f55-4b49-91ef-fb43efdc7fad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd056c-ecac-4205-840a-6df11ce64896]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:19:56 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:19:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd9a9d-d2e6-4420-826e-1a434525517d]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:19:56 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating existing volume attachment record: 4988e56e-9ba9-4f22-b3e3-15fb8343a1f5 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Successfully created port: da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Successfully updated port: da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquired lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-changed-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing instance network info cache due to event network-changed-da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] Acquiring lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:19:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG nova.network.neutron [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating instance_info_cache with network_info: [{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Releasing lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Instance network_info: |[{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] Acquired lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing network info cache for port da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updated VIF entry in instance network info cache for port da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG nova.network.neutron [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating instance_info_cache with network_info: [{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:19:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4b7b5fc1-5e6d-4c4f-980f-030dfdfe42a5 req-6062fd32-2329-4f35-84b3-1939129f33b2 service nova] Releasing lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:19:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:19:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:20:03 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Creating image(s)
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Ensure instance console log exists: /opt/stack/data/nova/instances/15c417e8-afda-473d-aa18-32014a65ef6b/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Start _get_guest_xml network_info=[{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'attachment_id': '4988e56e-9ba9-4f22-b3e3-15fb8343a1f5', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DruhQVwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15c417e8-afda-473d-aa18-32014a65ef6b', 'attached_at': '', 'detached_at': '', 'volume_id': '33b303b2-b8d3-43d3-9186-87fb0dfb442f', 'serial': '33b303b2-b8d3-43d3-9186-87fb0dfb442f'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:20:03 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:03 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DruhQVwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:20:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:20:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:20:03 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8a369f-3a68-4fa6-ac09-e694487d505e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:20:03 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537dd51-4fcb-4574-a6f4-e9d4d6b8b6dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f] added
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95955fcd-4382-44e9-8aa7-aaab9ac0dc72]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec86f0-58d2-4121-8163-db64a866e0f0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DruhQVwt {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DruhQVwt" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdf2256-c2c2-4a14-aed7-c6ddb28c68fd]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DruhQVwt'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d5a075-a9f0-4b29-95c1-f8e13cb773f9]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7801a-c168-4caa-94ab-4e5be1739c46]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b359f40-37a1-4090-81aa-9e90ca7f61db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260]
Jul 27 18:20:03 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260] successful.
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e0754-8cab-4b94-a90a-2d19588ab957]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad5638-83e0-424f-81ac-45c5aff8a47e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:03 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9cc434-3386-4385-a660-2b6ec09bf71e]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:03 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DruhQVwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23930666637613038', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:20:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930666637613038', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1751245101',display_name='tempest-TestVolumeBootPattern-server-1751245101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1751245101',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-p00lu405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:56Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=15c417e8-afda-473d-aa18-32014a65ef6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'pci_devices' on Instance uuid 15c417e8-afda-473d-aa18-32014a65ef6b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:20:05 user nova-compute[71206]:   <uuid>15c417e8-afda-473d-aa18-32014a65ef6b</uuid>
Jul 27 18:20:05 user nova-compute[71206]:   <name>instance-0000002b</name>
Jul 27 18:20:05 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:20:05 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:20:05 user nova-compute[71206]:   <metadata>
Jul 27 18:20:05 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:20:05 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:20:05 user nova-compute[71206]:       <nova:name>tempest-TestVolumeBootPattern-server-1751245101</nova:name>
Jul 27 18:20:05 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:20:03</nova:creationTime>
Jul 27 18:20:05 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:20:05 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:20:05 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:20:05 user nova-compute[71206]:       <nova:owner>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:user uuid="27abded262da493aa617c1c4b3fc86ec">tempest-TestVolumeBootPattern-1571765582-project-member</nova:user>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:project uuid="9ea22847821f4d6d9a2a6b127ee5ce6b">tempest-TestVolumeBootPattern-1571765582</nova:project>
Jul 27 18:20:05 user nova-compute[71206]:       </nova:owner>
Jul 27 18:20:05 user nova-compute[71206]:       <nova:ports>
Jul 27 18:20:05 user nova-compute[71206]:         <nova:port uuid="da043afd-7439-4b0d-816d-a516935af84f">
Jul 27 18:20:05 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 18:20:05 user nova-compute[71206]:         </nova:port>
Jul 27 18:20:05 user nova-compute[71206]:       </nova:ports>
Jul 27 18:20:05 user nova-compute[71206]:     </nova:instance>
Jul 27 18:20:05 user nova-compute[71206]:   </metadata>
Jul 27 18:20:05 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:20:05 user nova-compute[71206]:     <system>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="serial">15c417e8-afda-473d-aa18-32014a65ef6b</entry>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="uuid">15c417e8-afda-473d-aa18-32014a65ef6b</entry>
Jul 27 18:20:05 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:20:05 user nova-compute[71206]:     </system>
Jul 27 18:20:05 user nova-compute[71206]:   </sysinfo>
Jul 27 18:20:05 user nova-compute[71206]:   <os>
Jul 27 18:20:05 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:20:05 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:20:05 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:20:05 user nova-compute[71206]:   </os>
Jul 27 18:20:05 user nova-compute[71206]:   <features>
Jul 27 18:20:05 user nova-compute[71206]:     <acpi/>
Jul 27 18:20:05 user nova-compute[71206]:     <apic/>
Jul 27 18:20:05 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:20:05 user nova-compute[71206]:   </features>
Jul 27 18:20:05 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:20:05 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:20:05 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:20:05 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:20:05 user nova-compute[71206]:   </clock>
Jul 27 18:20:05 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:20:05 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:20:05 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:20:05 user nova-compute[71206]:   </cpu>
Jul 27 18:20:05 user nova-compute[71206]:   <devices>
Jul 27 18:20:05 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:20:05 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:20:05 user nova-compute[71206]:       <source dev="/dev/sdb"/>
Jul 27 18:20:05 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:20:05 user nova-compute[71206]:       <serial>33b303b2-b8d3-43d3-9186-87fb0dfb442f</serial>
Jul 27 18:20:05 user nova-compute[71206]:     </disk>
Jul 27 18:20:05 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:20:05 user nova-compute[71206]:       <mac address="fa:16:3e:bb:0f:04"/>
Jul 27 18:20:05 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:05 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:20:05 user nova-compute[71206]:       <target dev="tapda043afd-74"/>
Jul 27 18:20:05 user nova-compute[71206]:     </interface>
Jul 27 18:20:05 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:20:05 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/15c417e8-afda-473d-aa18-32014a65ef6b/console.log" append="off"/>
Jul 27 18:20:05 user nova-compute[71206]:     </serial>
Jul 27 18:20:05 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:20:05 user nova-compute[71206]:     <video>
Jul 27 18:20:05 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:05 user nova-compute[71206]:     </video>
Jul 27 18:20:05 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:20:05 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:20:05 user nova-compute[71206]:     </rng>
Jul 27 18:20:05 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:20:05 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:20:05 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:20:05 user nova-compute[71206]:     </memballoon>
Jul 27 18:20:05 user nova-compute[71206]:   </devices>
Jul 27 18:20:05 user nova-compute[71206]: </domain>
Jul 27 18:20:05 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1751245101',display_name='tempest-TestVolumeBootPattern-server-1751245101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1751245101',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-p00lu405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:19:56Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=15c417e8-afda-473d-aa18-32014a65ef6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG os_vif [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda043afd-74, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda043afd-74, col_values=(('external_ids', {'iface-id': 'da043afd-7439-4b0d-816d-a516935af84f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:0f:04', 'vm-uuid': '15c417e8-afda-473d-aa18-32014a65ef6b'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:05 user nova-compute[71206]: INFO os_vif [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74')
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:20:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] No VIF found with MAC fa:16:3e:bb:0f:04, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] No waiting events found dispatching network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:06 user nova-compute[71206]: WARNING nova.compute.manager [req-1372b5f5-1718-4e2e-ae34-f056933e3143 req-7ee7e186-6d6c-4577-a19b-67616aab0cc2 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received unexpected event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f for instance with vm_state building and task_state spawning.
Jul 27 18:20:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482008.6272159, 15c417e8-afda-473d-aa18-32014a65ef6b => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] VM Resumed (Lifecycle Event)
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Instance spawned successfully.
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482008.6315455, 15c417e8-afda-473d-aa18-32014a65ef6b => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] VM Started (Lifecycle Event)
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] No waiting events found dispatching network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:08 user nova-compute[71206]: WARNING nova.compute.manager [req-295adf90-14ed-43f6-9705-e864654a9250 req-dd58fded-e6a2-44f7-923f-b223169524da service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received unexpected event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f for instance with vm_state building and task_state spawning.
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Took 5.14 seconds to spawn the instance on the hypervisor.
Jul 27 18:20:08 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:08 user nova-compute[71206]: INFO nova.compute.manager [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Took 13.19 seconds to build instance.
Jul 27 18:20:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1f4df6a3-c43f-4f13-88de-d458b94bd8d6 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.321s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:10 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:19 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:20:19 user nova-compute[71206]: INFO nova.compute.claims [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Claim successful on node user
Jul 27 18:20:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:20:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.policy [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fb2e64d76d4952aed3839301da9af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d53f91aae484d95bb2a977e07116238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:20:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Creating image(s)
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "/opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk 1073741824" returned: 0 in 0.056s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Cannot resize image /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'migration_context' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Ensure instance console log exists: /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:21 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Successfully created port: 7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Successfully updated port: 7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquired lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-changed-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Refreshing instance network info cache due to event network-changed-7f47df03-4059-4d8e-9bd4-bf393e2d9a46. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] Acquiring lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Releasing lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Instance network_info: |[{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] Acquired lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Refreshing network info cache for port 7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Start _get_guest_xml network_info=[{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:20:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:22 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1150780681',display_name='tempest-AttachVolumeNegativeTest-server-1150780681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1150780681',id=44,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtUKVHnUUI5vCNSHYG4uWiG4FuoLvwyYH9Z2QOk8oELAevaHPhdXy9nSbdzWiAFmdSm+RwQWSDfa0RA+fRTrNYHUrw1Nh09fQ+LYshW+yQPv+JR3LUiCx+UXVjbbc9lww==',key_name='tempest-keypair-473847475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-ott2kag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=be45a058-3c13-4fdc-a133-9df172d9715f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'pci_devices' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:20:22 user nova-compute[71206]:   <uuid>be45a058-3c13-4fdc-a133-9df172d9715f</uuid>
Jul 27 18:20:22 user nova-compute[71206]:   <name>instance-0000002c</name>
Jul 27 18:20:22 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:20:22 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:20:22 user nova-compute[71206]:   <metadata>
Jul 27 18:20:22 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:20:22 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1150780681</nova:name>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:20:22</nova:creationTime>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:20:22 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:20:22 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:owner>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:user uuid="75fb2e64d76d4952aed3839301da9af9">tempest-AttachVolumeNegativeTest-1298407279-project-member</nova:user>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:project uuid="9d53f91aae484d95bb2a977e07116238">tempest-AttachVolumeNegativeTest-1298407279</nova:project>
Jul 27 18:20:22 user nova-compute[71206]:       </nova:owner>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:20:22 user nova-compute[71206]:       <nova:ports>
Jul 27 18:20:22 user nova-compute[71206]:         <nova:port uuid="7f47df03-4059-4d8e-9bd4-bf393e2d9a46">
Jul 27 18:20:22 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 18:20:22 user nova-compute[71206]:         </nova:port>
Jul 27 18:20:22 user nova-compute[71206]:       </nova:ports>
Jul 27 18:20:22 user nova-compute[71206]:     </nova:instance>
Jul 27 18:20:22 user nova-compute[71206]:   </metadata>
Jul 27 18:20:22 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:20:22 user nova-compute[71206]:     <system>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="serial">be45a058-3c13-4fdc-a133-9df172d9715f</entry>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="uuid">be45a058-3c13-4fdc-a133-9df172d9715f</entry>
Jul 27 18:20:22 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:20:22 user nova-compute[71206]:     </system>
Jul 27 18:20:22 user nova-compute[71206]:   </sysinfo>
Jul 27 18:20:22 user nova-compute[71206]:   <os>
Jul 27 18:20:22 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:20:22 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:20:22 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:20:22 user nova-compute[71206]:   </os>
Jul 27 18:20:22 user nova-compute[71206]:   <features>
Jul 27 18:20:22 user nova-compute[71206]:     <acpi/>
Jul 27 18:20:22 user nova-compute[71206]:     <apic/>
Jul 27 18:20:22 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:20:22 user nova-compute[71206]:   </features>
Jul 27 18:20:22 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:20:22 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:20:22 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:20:22 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:20:22 user nova-compute[71206]:   </clock>
Jul 27 18:20:22 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:20:22 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:20:22 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:20:22 user nova-compute[71206]:   </cpu>
Jul 27 18:20:22 user nova-compute[71206]:   <devices>
Jul 27 18:20:22 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:20:22 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:20:22 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk"/>
Jul 27 18:20:22 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:20:22 user nova-compute[71206]:     </disk>
Jul 27 18:20:22 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:20:22 user nova-compute[71206]:       <mac address="fa:16:3e:96:91:bc"/>
Jul 27 18:20:22 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:22 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:20:22 user nova-compute[71206]:       <target dev="tap7f47df03-40"/>
Jul 27 18:20:22 user nova-compute[71206]:     </interface>
Jul 27 18:20:22 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:20:22 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/console.log" append="off"/>
Jul 27 18:20:22 user nova-compute[71206]:     </serial>
Jul 27 18:20:22 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:20:22 user nova-compute[71206]:     <video>
Jul 27 18:20:22 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:22 user nova-compute[71206]:     </video>
Jul 27 18:20:22 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:20:22 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:20:22 user nova-compute[71206]:     </rng>
Jul 27 18:20:22 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:20:22 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:20:22 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:20:22 user nova-compute[71206]:     </memballoon>
Jul 27 18:20:22 user nova-compute[71206]:   </devices>
Jul 27 18:20:22 user nova-compute[71206]: </domain>
Jul 27 18:20:22 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1150780681',display_name='tempest-AttachVolumeNegativeTest-server-1150780681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1150780681',id=44,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtUKVHnUUI5vCNSHYG4uWiG4FuoLvwyYH9Z2QOk8oELAevaHPhdXy9nSbdzWiAFmdSm+RwQWSDfa0RA+fRTrNYHUrw1Nh09fQ+LYshW+yQPv+JR3LUiCx+UXVjbbc9lww==',key_name='tempest-keypair-473847475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-ott2kag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=be45a058-3c13-4fdc-a133-9df172d9715f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG os_vif [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f47df03-40, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f47df03-40, col_values=(('external_ids', {'iface-id': '7f47df03-4059-4d8e-9bd4-bf393e2d9a46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:91:bc', 'vm-uuid': 'be45a058-3c13-4fdc-a133-9df172d9715f'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:22 user nova-compute[71206]: INFO os_vif [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40')
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:20:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:96:91:bc, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:20:23 user nova-compute[71206]: DEBUG nova.network.neutron [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updated VIF entry in instance network info cache for port 7f47df03-4059-4d8e-9bd4-bf393e2d9a46. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:20:23 user nova-compute[71206]: DEBUG nova.network.neutron [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0f7f876d-7ce8-4483-ad1b-c193050299b7 req-102bfc11-1dee-44dc-aaac-4e67e5bf6cd4 service nova] Releasing lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:24 user nova-compute[71206]: WARNING nova.compute.manager [req-3d2cad84-0db1-47b6-b3e3-98f015000076 req-c4dfec1c-ceff-4c39-993a-56ea6dd4b87c service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state building and task_state spawning.
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482026.4201717, be45a058-3c13-4fdc-a133-9df172d9715f => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] VM Resumed (Lifecycle Event)
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Instance spawned successfully.
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482026.420512, be45a058-3c13-4fdc-a133-9df172d9715f => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] VM Started (Lifecycle Event)
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:26 user nova-compute[71206]: WARNING nova.compute.manager [req-f29946bb-02de-4db5-89e6-a0bbeecf8809 req-2c5c60d3-40ed-4a87-bc2f-40667272c97b service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state building and task_state spawning.
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 27 18:20:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:26 user nova-compute[71206]: INFO nova.compute.manager [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Took 6.66 seconds to build instance.
Jul 27 18:20:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e0957b3e-19ef-482c-997f-4928ddc68ab7 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.760s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:20:40 user nova-compute[71206]: INFO nova.compute.claims [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Claim successful on node user
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.423s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:20:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.policy [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10d22eb4c8854094911f42be4e187f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe752f93ac64502bac3369f21987aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:20:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Creating image(s)
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "/opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "/opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk 1073741824" returned: 0 in 0.060s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Cannot resize image /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'migration_context' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Successfully created port: acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Ensure instance console log exists: /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Successfully updated port: acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquired lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-changed-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.compute.manager [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Refreshing instance network info cache due to event network-changed-acf2ba23-da68-4ffb-acff-fb7bf3264a9d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] Acquiring lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.network.neutron [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating instance_info_cache with network_info: [{"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Releasing lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Instance network_info: |[{"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] Acquired lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.network.neutron [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Refreshing network info cache for port acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Start _get_guest_xml network_info=[{"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:20:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:42 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:20:42 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741658315',display_name='tempest-VolumesSnapshotTestJSON-instance-741658315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741658315',id=45,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH61iJ1sKqfUC20ffFXOKMu2O/4/vxvexThz4YOGJNv/T4fJMBXH1zy1IWBWt4a+cdfbu/bFtMHhjLOszDnSCSAUwTpVVOxEdEohsivo9finGhDvn6W2IEsAWqyipL+SA==',key_name='tempest-keypair-793822298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-gj6wjo4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=e4dc9a47-d6fe-40cd-8041-34f34843e8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'pci_devices' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:20:43 user nova-compute[71206]:   <uuid>e4dc9a47-d6fe-40cd-8041-34f34843e8ec</uuid>
Jul 27 18:20:43 user nova-compute[71206]:   <name>instance-0000002d</name>
Jul 27 18:20:43 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:20:43 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:20:43 user nova-compute[71206]:   <metadata>
Jul 27 18:20:43 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:20:43 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-741658315</nova:name>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:20:42</nova:creationTime>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:20:43 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:20:43 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:owner>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:user uuid="10d22eb4c8854094911f42be4e187f08">tempest-VolumesSnapshotTestJSON-1946142319-project-member</nova:user>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:project uuid="7fe752f93ac64502bac3369f21987aaa">tempest-VolumesSnapshotTestJSON-1946142319</nova:project>
Jul 27 18:20:43 user nova-compute[71206]:       </nova:owner>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:20:43 user nova-compute[71206]:       <nova:ports>
Jul 27 18:20:43 user nova-compute[71206]:         <nova:port uuid="acf2ba23-da68-4ffb-acff-fb7bf3264a9d">
Jul 27 18:20:43 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:20:43 user nova-compute[71206]:         </nova:port>
Jul 27 18:20:43 user nova-compute[71206]:       </nova:ports>
Jul 27 18:20:43 user nova-compute[71206]:     </nova:instance>
Jul 27 18:20:43 user nova-compute[71206]:   </metadata>
Jul 27 18:20:43 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:20:43 user nova-compute[71206]:     <system>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="serial">e4dc9a47-d6fe-40cd-8041-34f34843e8ec</entry>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="uuid">e4dc9a47-d6fe-40cd-8041-34f34843e8ec</entry>
Jul 27 18:20:43 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:20:43 user nova-compute[71206]:     </system>
Jul 27 18:20:43 user nova-compute[71206]:   </sysinfo>
Jul 27 18:20:43 user nova-compute[71206]:   <os>
Jul 27 18:20:43 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:20:43 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:20:43 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:20:43 user nova-compute[71206]:   </os>
Jul 27 18:20:43 user nova-compute[71206]:   <features>
Jul 27 18:20:43 user nova-compute[71206]:     <acpi/>
Jul 27 18:20:43 user nova-compute[71206]:     <apic/>
Jul 27 18:20:43 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:20:43 user nova-compute[71206]:   </features>
Jul 27 18:20:43 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:20:43 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:20:43 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:20:43 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:20:43 user nova-compute[71206]:   </clock>
Jul 27 18:20:43 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:20:43 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:20:43 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:20:43 user nova-compute[71206]:   </cpu>
Jul 27 18:20:43 user nova-compute[71206]:   <devices>
Jul 27 18:20:43 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:20:43 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:20:43 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk"/>
Jul 27 18:20:43 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:20:43 user nova-compute[71206]:     </disk>
Jul 27 18:20:43 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:20:43 user nova-compute[71206]:       <mac address="fa:16:3e:d4:2c:87"/>
Jul 27 18:20:43 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:43 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:20:43 user nova-compute[71206]:       <target dev="tapacf2ba23-da"/>
Jul 27 18:20:43 user nova-compute[71206]:     </interface>
Jul 27 18:20:43 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:20:43 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/console.log" append="off"/>
Jul 27 18:20:43 user nova-compute[71206]:     </serial>
Jul 27 18:20:43 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:20:43 user nova-compute[71206]:     <video>
Jul 27 18:20:43 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:20:43 user nova-compute[71206]:     </video>
Jul 27 18:20:43 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:20:43 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:20:43 user nova-compute[71206]:     </rng>
Jul 27 18:20:43 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:20:43 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:20:43 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:20:43 user nova-compute[71206]:     </memballoon>
Jul 27 18:20:43 user nova-compute[71206]:   </devices>
Jul 27 18:20:43 user nova-compute[71206]: </domain>
Jul 27 18:20:43 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741658315',display_name='tempest-VolumesSnapshotTestJSON-instance-741658315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741658315',id=45,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH61iJ1sKqfUC20ffFXOKMu2O/4/vxvexThz4YOGJNv/T4fJMBXH1zy1IWBWt4a+cdfbu/bFtMHhjLOszDnSCSAUwTpVVOxEdEohsivo9finGhDvn6W2IEsAWqyipL+SA==',key_name='tempest-keypair-793822298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-gj6wjo4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=e4dc9a47-d6fe-40cd-8041-34f34843e8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG os_vif [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacf2ba23-da, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacf2ba23-da, col_values=(('external_ids', {'iface-id': 'acf2ba23-da68-4ffb-acff-fb7bf3264a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:2c:87', 'vm-uuid': 'e4dc9a47-d6fe-40cd-8041-34f34843e8ec'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:43 user nova-compute[71206]: INFO os_vif [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da')
Jul 27 18:20:43 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:43 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7154MB free_disk=25.138710021972656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No VIF found with MAC fa:16:3e:d4:2c:87, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Applying migration context for instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb as it has an incoming, in-progress migration d9fd6f00-0891-4ad5-b19e-a8a728a15180. Migration status is finished {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 18:20:43 user nova-compute[71206]: INFO nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating resource usage from migration d9fd6f00-0891-4ad5-b19e-a8a728a15180
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7a3a1a62-0246-475c-b346-35aab836bf84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a9ee747d-0e26-4db1-be46-b31318ffa30d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3e5847a2-1036-49e3-b657-69476f8becce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance cde8dfde-fed8-4ad1-9d0f-3901d3105a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Migration d9fd6f00-0891-4ad5-b19e-a8a728a15180 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f606f8e4-7da8-4d29-9098-245d114cec8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 15c417e8-afda-473d-aa18-32014a65ef6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updated VIF entry in instance network info cache for port acf2ba23-da68-4ffb-acff-fb7bf3264a9d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.network.neutron [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating instance_info_cache with network_info: [{"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-2c222f1a-0a28-4cc3-99e7-c61903b157a7 req-721ba30b-9e42-4086-84f1-044184460dba service nova] Releasing lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:20:43 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] No waiting events found dispatching network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:45 user nova-compute[71206]: WARNING nova.compute.manager [req-b5321de7-2b44-47f4-8ba3-d88e00d760e5 req-42c39012-98ef-4489-9e57-9619ef2cc609 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received unexpected event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d for instance with vm_state building and task_state spawning.
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Skipping network cache update for instance because it is Building. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [{"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-d4764a2f-d9e3-40e9-933f-29374922e420" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482047.015415, e4dc9a47-d6fe-40cd-8041-34f34843e8ec => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] VM Resumed (Lifecycle Event)
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Instance spawned successfully.
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482047.016856, e4dc9a47-d6fe-40cd-8041-34f34843e8ec => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] VM Started (Lifecycle Event)
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] No waiting events found dispatching network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:47 user nova-compute[71206]: WARNING nova.compute.manager [req-4cdc4042-17e4-4f76-8be3-bb38624104a1 req-ca078aa3-5056-4de8-a9e3-35ec7249fc39 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received unexpected event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d for instance with vm_state building and task_state spawning.
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-changed-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing instance network info cache due to event network-changed-0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] Acquiring lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] Acquired lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Took 7.21 seconds to build instance.
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6eeb0b0a-c3b4-4ed2-a3aa-ea4f2e68b1c4 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.307s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updated VIF entry in instance network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating instance_info_cache with network_info: [{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0263eda6-0e70-46b4-90d0-89c24f7d3143 req-b1fd83d8-1b96-4557-baa4-b217d5462a58 service nova] Releasing lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:47 user nova-compute[71206]: INFO nova.compute.manager [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Attaching volume 635c9101-b2cf-4301-bed5-a8fbea1603e0 to /dev/vdb
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.utils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa961d67-a644-49ce-b7f3-c5413b3471c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c02017-6345-44c2-955d-2be06908dbdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cdd6b7-ebe1-4262-9a82-18319f05f987]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d37b0f-013d-4718-b51f-e62b7a79b858]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:20:48 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:20:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2062f1-2772-4a1c-af02-f1b0fff527e8]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG os_brick.utils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:20:48 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating existing volume attachment record: 8524c184-293a-4271-b3b2-95a4c016c0a9 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:20:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-changed-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Refreshing instance network info cache due to event network-changed-24be62b7-60b7-4739-9266-4e10c907e53c. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:20:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] Acquiring lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] Acquired lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Refreshing network info cache for port 24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:20:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updated VIF entry in instance network info cache for port 24be62b7-60b7-4739-9266-4e10c907e53c. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:20:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating instance_info_cache with network_info: [{"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-25a8b26b-f2e7-47d4-9f90-e20b42729502 req-37c388bb-1a01-4612-84b5-e5a80e41bbe9 service nova] Releasing lock "refresh_cache-3e5847a2-1036-49e3-b657-69476f8becce" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:20:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:20:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:20:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbNfeYOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:20:55 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:20:55 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:20:55 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5ee6f-a261-4768-b78e-227274a54525]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:20:55 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf0e6bb-476d-4777-961a-1ad44bef9868]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0] added
Jul 27 18:20:55 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa8f5bd-7f2b-456e-8b0c-480856b7a8df]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e055b9f2-a794-46c6-8da8-c9746655000b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbNfeYOl {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbNfeYOl" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099b3ec-2026-4d4b-88b6-43f7e7239779]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbNfeYOl'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a4ce3-e7d4-40ff-a523-2ea127cb4600]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.objects.instance [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'flavor' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b0cc7-048b-4849-955c-07bb54960ef3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:56 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:56 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e536fa9-2f18-48fd-a402-991fc5fd8568]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260]
Jul 27 18:20:56 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260] successful.
Jul 27 18:20:56 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a55fd-f1bb-412a-a48d-11433f9bfc52]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8eaef-a6f3-41c3-8e23-dfe903e63454]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:20:56 user nova-compute[71206]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)
Jul 27 18:20:56 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[960aefbb-601e-42a8-90bf-264ff87d6ec3]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbNfeYOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.compute.manager [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Terminating instance
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.compute.manager [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Attaching volume 1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f to /dev/vdb
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a529927-4b0b-4001-9bf3-1ee3594b7717]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7abf1-ea7c-42e8-be8c-d993bff4349c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec1434-a7b5-40a2-84bc-8d8958b26c23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6bffa-5080-4893-a934-0c95363abc42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:20:56 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b4b55-7124-43ac-b877-0d4a0d17d141]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_brick.utils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating existing volume attachment record: b9ede0db-9b37-4161-aa64-bb40bb7c692a {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-unplugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] No waiting events found dispatching network-vif-unplugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa30c80a-3d89-43a2-8b36-97f8040a382f req-9e12332e-0fbd-4508-b2ec-31c3ee5ac081 service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-unplugged-012eaf98-ffab-4f98-b553-a1896031fa6a for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Instance destroyed successfully.
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lazy-loading 'resources' on Instance uuid cde8dfde-fed8-4ad1-9d0f-3901d3105a33 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2067773294',display_name='tempest-VolumesNegativeTest-instance-2067773294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2067773294',id=41,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c0f20dedb8e44bd907a606d33f49537',ramdisk_id='',reservation_id='r-uudz0748',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1606252313',owner_user_name='tempest-VolumesNegativeTest-1606252313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:16Z,user_data=None,user_id='5d2a4b2e922c4e68a5c361749aafaa79',uuid=cde8dfde-fed8-4ad1-9d0f-3901d3105a33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converting VIF {"id": "012eaf98-ffab-4f98-b553-a1896031fa6a", "address": "fa:16:3e:77:1f:20", "network": {"id": "89d0a0a7-a72b-43a7-8ebc-69c733f277e5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c051be61314e4a00a452af401ae871b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012eaf98-ff", "ovs_interfaceid": "012eaf98-ffab-4f98-b553-a1896031fa6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG os_vif [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap012eaf98-ff, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:20:56 user nova-compute[71206]: INFO os_vif [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:20,bridge_name='br-int',has_traffic_filtering=True,id=012eaf98-ffab-4f98-b553-a1896031fa6a,network=Network(89d0a0a7-a72b-43a7-8ebc-69c733f277e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012eaf98-ff')
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Deleting instance files /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33_del
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Deletion of /opt/stack/data/nova/instances/cde8dfde-fed8-4ad1-9d0f-3901d3105a33_del complete
Jul 27 18:20:56 user nova-compute[71206]: INFO nova.compute.manager [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Took 0.69 seconds to destroy the instance on the hypervisor.
Jul 27 18:20:56 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:20:56 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23837346363346139', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837346363346139', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:20:57 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:20:57 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:20:57 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:20:57 user nova-compute[71206]:   <serial>635c9101-b2cf-4301-bed5-a8fbea1603e0</serial>
Jul 27 18:20:57 user nova-compute[71206]: </disk>
Jul 27 18:20:57 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:20:57 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Took 0.65 seconds to deallocate network for instance.
Jul 27 18:20:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] No VIF found with MAC fa:16:3e:06:f2:d7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-4160c460-d2a0-4bfe-a6c2-9a293ffea6a7 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.871s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:20:57 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:58 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Deleted allocations for instance cde8dfde-fed8-4ad1-9d0f-3901d3105a33
Jul 27 18:20:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b99a5938-12fe-4f37-af09-05d39fa835ca tempest-VolumesNegativeTest-1606252313 tempest-VolumesNegativeTest-1606252313-project-member] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] Acquiring lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] Lock "cde8dfde-fed8-4ad1-9d0f-3901d3105a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:20:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] No waiting events found dispatching network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:20:58 user nova-compute[71206]: WARNING nova.compute.manager [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received unexpected event network-vif-plugged-012eaf98-ffab-4f98-b553-a1896031fa6a for instance with vm_state deleted and task_state None.
Jul 27 18:20:58 user nova-compute[71206]: DEBUG nova.compute.manager [req-00b3a840-0910-41c1-bb74-f1cc3009102f req-245f7c97-cdf0-48de-93b3-e80ff6240a1c service nova] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Received event network-vif-deleted-012eaf98-ffab-4f98-b553-a1896031fa6a {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Going to confirm migration 2 {{(pid=71206) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'info_cache' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:20:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:00 user nova-compute[71206]: INFO nova.compute.manager [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Detaching volume 635c9101-b2cf-4301-bed5-a8fbea1603e0
Jul 27 18:21:00 user nova-compute[71206]: INFO nova.virt.block_device [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Attempting to driver detach volume 635c9101-b2cf-4301-bed5-a8fbea1603e0 from mountpoint /dev/vdb
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Attempting to detach device vdb from instance a9ee747d-0e26-4db1-be46-b31318ffa30d from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:21:00 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:00 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:00 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:00 user nova-compute[71206]:   <serial>635c9101-b2cf-4301-bed5-a8fbea1603e0</serial>
Jul 27 18:21:00 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:21:00 user nova-compute[71206]: </disk>
Jul 27 18:21:00 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully detached device vdb from instance a9ee747d-0e26-4db1-be46-b31318ffa30d from the persistent domain config.
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9ee747d-0e26-4db1-be46-b31318ffa30d from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:21:00 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:00 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:00 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:00 user nova-compute[71206]:   <serial>635c9101-b2cf-4301-bed5-a8fbea1603e0</serial>
Jul 27 18:21:00 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:21:00 user nova-compute[71206]: </disk>
Jul 27 18:21:00 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.objects.instance [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'migration_context' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.452s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482060.6029873, a9ee747d-0e26-4db1-be46-b31318ffa30d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:21:00 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully detached device vdb from instance a9ee747d-0e26-4db1-be46-b31318ffa30d from the live domain config.
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbNfeYOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46d575-6f5e-44bf-9880-45b20c61c238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:21:00 user nova-compute[71206]: No targets found.
Jul 27 18:21:00 user nova-compute[71206]: iSNS:
Jul 27 18:21:00 user nova-compute[71206]: No targets found.
Jul 27 18:21:00 user nova-compute[71206]: STATIC:
Jul 27 18:21:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f
Jul 27 18:21:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0
Jul 27 18:21:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:21:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:00 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:21:00 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:00 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:00 user nova-compute[71206]: FIRMWARE:
Jul 27 18:21:00 user nova-compute[71206]: No targets found.
Jul 27 18:21:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:21:00 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:21:00 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe398b3-8d32-4fb9-a47d-2cd0c6f4bad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f984e-964f-46f7-b682-c7f34d36ace1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:00 user nova-compute[71206]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 (non-flash)
Jul 27 18:21:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c50f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4989659-70b7-458d-b069-4db01227ebcd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2940b8-baaa-4e44-b59e-1a49c5ec28d0]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1740df8-62a2-4de8-8897-d0c4d2912ab4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5a94d-bcbb-49f0-a70e-b32b1975ea31]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:21:00 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Deleted allocation for migration d9fd6f00-0891-4ad5-b19e-a8a728a15180
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[110099c1-8096-4ae8-9d22-d4a662a29df1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-27a7dc48-b184-499f-bf23-74d827fbf3ea tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.554s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf4583-71dd-4854-9ae1-3d0b71336cb6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260]
Jul 27 18:21:00 user nova-compute[71206]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:00 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:635c9101-b2cf-4301-bed5-a8fbea1603e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98549963-2a35-4efd-b123-3cc6ea5c4b44]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] <== disconnect_volume: return (317ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:21:01 user nova-compute[71206]: DEBUG nova.objects.instance [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'flavor' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-44d52556-7285-481d-84a2-c6fda655b287 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.719s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdcEOfwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:03 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:03 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b7624c-18f8-4161-a78e-95d7fc188daf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:21:03 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de82f70-436b-48b7-8128-c060fbf148b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f] added
Jul 27 18:21:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fcb8fc-8a55-447c-880c-4c35da7f7372]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a3c1f0-15de-40a9-b8a0-545ba9c60089]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdcEOfwg {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdcEOfwg" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add94b5-28b7-4a11-9b78-67eb1d345bdc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdcEOfwg'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a6b79-1b42-46ef-88e4-f8ab49c9cfed]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19449be1-b2a7-4bb7-a1b4-855602a4a2e3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:03 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:03 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:03 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:03 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:03 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4723de-3715-4485-bda2-f97bfb17e369]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260]
Jul 27 18:21:04 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d32d90-23fe-4dcc-95ce-619f226206d7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0944a7ab-1434-4982-bdd6-29b3737664ef]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)
Jul 27 18:21:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:04 user nova-compute[71206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)
Jul 27 18:21:04 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b6b40-815f-476a-861e-7e70aeff7341]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdcEOfwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26665383538616237', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665383538616237', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.objects.instance [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'flavor' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:21:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:05 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:05 user nova-compute[71206]:   <serial>1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f</serial>
Jul 27 18:21:05 user nova-compute[71206]: </disk>
Jul 27 18:21:05 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] No VIF found with MAC fa:16:3e:03:18:e0, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:21:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-361c0e77-0ddf-4dfd-8677-2268d3181ebe tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.434s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:06 user nova-compute[71206]: INFO nova.compute.manager [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Detaching volume 1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f
Jul 27 18:21:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:06 user nova-compute[71206]: INFO nova.virt.block_device [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Attempting to driver detach volume 1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f from mountpoint /dev/vdb
Jul 27 18:21:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Attempting to detach device vdb from instance 3e5847a2-1036-49e3-b657-69476f8becce from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:21:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:21:06 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:06 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:06 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:06 user nova-compute[71206]:   <serial>1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f</serial>
Jul 27 18:21:06 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:21:06 user nova-compute[71206]: </disk>
Jul 27 18:21:06 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:21:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Successfully detached device vdb from instance 3e5847a2-1036-49e3-b657-69476f8becce from the persistent domain config.
Jul 27 18:21:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e5847a2-1036-49e3-b657-69476f8becce from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:21:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:21:06 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:06 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:06 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:06 user nova-compute[71206]:   <serial>1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f</serial>
Jul 27 18:21:06 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:21:06 user nova-compute[71206]: </disk>
Jul 27 18:21:06 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482067.3272517, 3e5847a2-1036-49e3-b657-69476f8becce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:21:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Successfully detached device vdb from instance 3e5847a2-1036-49e3-b657-69476f8becce from the live domain config.
Jul 27 18:21:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdcEOfwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:07 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d69ef-7ec8-416c-a068-84b950963715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:21:07 user nova-compute[71206]: No targets found.
Jul 27 18:21:07 user nova-compute[71206]: iSNS:
Jul 27 18:21:07 user nova-compute[71206]: No targets found.
Jul 27 18:21:07 user nova-compute[71206]: STATIC:
Jul 27 18:21:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f
Jul 27 18:21:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f
Jul 27 18:21:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:21:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:07 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:21:07 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:07 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:07 user nova-compute[71206]: FIRMWARE:
Jul 27 18:21:07 user nova-compute[71206]: No targets found.
Jul 27 18:21:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:21:07 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:21:07 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd024958-a7b2-497e-aee8-88bc5d6c12e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b4e859-d9be-44d3-8421-de36103cb134]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)
Jul 27 18:21:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:07 user nova-compute[71206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f (non-flash)
Jul 27 18:21:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c504c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad374ff-5482-4462-805a-ff1d0a915ffa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5fbee-5f7b-44fc-ac99-c4fdd82c7424]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8312d4-a332-41cc-bb30-62cdea188b74]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd89c70-0800-4558-80eb-490b99a57651]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63d90c-4c76-453f-ad81-0bf4d96d1f74]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c13f7-94eb-419e-8537-247b72323f8f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260]
Jul 27 18:21:07 user nova-compute[71206]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:07 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8f7e5c-dfe8-44bb-91af-ccc5a5e7a89f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85550ebe-b1d9-4b5d-827b-93b35ea950bb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] <== disconnect_volume: return (316ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:21:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'flavor' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cd39ad10-92f5-4e01-8f59-382a1f4832ed tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:11 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482056.8063736, cde8dfde-fed8-4ad1-9d0f-3901d3105a33 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:21:11 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] VM Stopped (Lifecycle Event)
Jul 27 18:21:11 user nova-compute[71206]: DEBUG nova.compute.manager [None req-33f9b6dd-ca9e-43b7-9a83-591d8ee0a377 None None] [instance: cde8dfde-fed8-4ad1-9d0f-3901d3105a33] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:21:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:13 user nova-compute[71206]: INFO nova.compute.manager [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Attaching volume dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 to /dev/vdb
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.utils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0c58c5-fd73-4e48-9af5-d3c4a8bebc72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5656851-a4c6-43ac-b597-312ba4320205]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d2f2a-0658-4f9a-8c51-1fbe20dbb071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa1a4f-fa97-4ac8-998b-7d517ad2bf77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:21:13 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:21:13 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f852aa-bcef-4c30-a720-fb328433b0d0]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG os_brick.utils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:13 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating existing volume attachment record: 9bd95106-0bd2-4b41-a037-f124e98107ed {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:21:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:20 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7bcffa-bf86-4d62-bedb-c7d547e10d20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:21:20 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2073950-46c5-4f68-afc7-95b692c6d200]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11] added
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b960b-cf0c-43ae-a5de-b6398b5c1c85]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e294d382-3e03-4288-9143-8f73d919b25a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDjgysYO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDjgysYO" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e28fda-7454-4163-aaf0-8fd096f2559c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nDjgysYO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[902cb2a1-0d37-40e2-9880-feef0985678c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d45084e-b6c2-44a4-83df-a5e0c5a66391]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82a3b1-a431-45ed-a2c3-efa0ba73624b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]
Jul 27 18:21:20 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f098a21-872c-4327-9cc5-559d11d58711]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a4e32-1cf2-4943-a863-df54790d17fc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:20 user nova-compute[71206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44f609-5ed2-4484-b742-aae389e44364]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26666316331356530', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666316331356530', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:21:21 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:21:22 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:22 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:21:22 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:21:22 user nova-compute[71206]:   <serial>dbaed406-7b7a-41e4-a356-fa9bd9e1ea11</serial>
Jul 27 18:21:22 user nova-compute[71206]: </disk>
Jul 27 18:21:22 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:21:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:21:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:21:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No VIF found with MAC fa:16:3e:c9:de:8f, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:21:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b2cb98b8-a809-4b92-8c80-e3dd63dfe714 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.879s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-changed-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing instance network info cache due to event network-changed-36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updated VIF entry in instance network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-cddaf77b-3679-4019-9cf2-9a1bf8282757 req-b256f85b-6cf6-4cb7-943b-6028ec3a8f12 service nova] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-changed-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing instance network info cache due to event network-changed-36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG nova.network.neutron [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:21:33 user nova-compute[71206]: DEBUG nova.network.neutron [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updated VIF entry in instance network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:21:34 user nova-compute[71206]: DEBUG nova.network.neutron [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-202d42ee-9916-4a44-9cce-bb095201cfe7 req-a7f3d9a8-13b4-44a9-b7b7-d5f1808f830c service nova] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:38 user nova-compute[71206]: INFO nova.compute.manager [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Rebooting instance
Jul 27 18:21:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:38 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:39 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:39 user nova-compute[71206]: WARNING nova.compute.manager [req-5d0fbcf4-8c91-4d02-9b02-8bed89d50a31 req-cfcb8768-8071-4f57-bfc6-d6dfaacc0232 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state active and task_state reboot_started_hard.
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:40 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance destroyed successfully.
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'resources' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:21:39Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36e87352-0e, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:40 user nova-compute[71206]: INFO os_vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e')
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4d8f7-0829-46df-852c-9b8d8fc55999]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:21:40 user nova-compute[71206]: No targets found.
Jul 27 18:21:40 user nova-compute[71206]: iSNS:
Jul 27 18:21:40 user nova-compute[71206]: No targets found.
Jul 27 18:21:40 user nova-compute[71206]: STATIC:
Jul 27 18:21:40 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:21:40 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:40 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:40 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f
Jul 27 18:21:40 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:40 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:40 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:21:40 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:40 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:40 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:21:40 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:40 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:40 user nova-compute[71206]: FIRMWARE:
Jul 27 18:21:40 user nova-compute[71206]: No targets found.
Jul 27 18:21:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:21:40 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:21:40 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb5f3d2-934b-4188-b158-16150c2d3c07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88be9c8b-b65b-4da1-9d07-d7db8a1b7e03]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:40 user nova-compute[71206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c2c1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede39695-9b4f-4247-a03c-70098c96f48b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f96b760-39fd-4eec-9dcf-4d5aa58590ed]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e1d3c-66f0-4f75-9110-59a8dd438264]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22217a49-95d9-4e47-834a-ecffa7e4bcf0]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0deb2-fc41-4ef2-b2a8-886a3bee0342]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9d50b5-4829-466d-a07f-29313fde3879]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]
Jul 27 18:21:40 user nova-compute[71206]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b79cf22-5b59-42f8-b967-3064d2467952]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== disconnect_volume: return (311ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start _get_guest_xml network_info=[{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e4fd959f-93e5-4b84-b0c6-ce0307c9a366,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'e4fd959f-93e5-4b84-b0c6-ce0307c9a366'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'attachment_id': '9bd95106-0bd2-4b41-a037-f124e98107ed', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f606f8e4-7da8-4d29-9098-245d114cec8b', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'serial': 'dbaed406-7b7a-41e4-a356-fa9bd9e1ea11'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:21:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:21:40 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e4fd959f-93e5-4b84-b0c6-ce0307c9a366,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'vcpu_model' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:40 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451de8b-4906-4b58-8f55-8f87a677a39a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:21:40 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6012a5f-231e-4b0d-a78a-f1b1ae2a8475]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11] added
Jul 27 18:21:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c04fce5-cb2d-4f44-88dc-dd0ad90c71d3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9a1d32-3725-4ff7-b519-1c3ecc822337]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDjgysYO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDjgysYO" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a82934-d4b0-429d-a23c-039b540203fa]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nDjgysYO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1959739-4183-4797-a164-44ae77c79088]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8925054d-df54-4ef8-a13f-23c19d8cb303]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a642e167-912f-44a4-a2b7-bf62a31878ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]
Jul 27 18:21:41 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd0311-c25a-4843-b113-6771a73c9784]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa335365-f054-4eea-998a-259c8175e577]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:41 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8438d3-b1c6-4706-bcc6-af115fd78974]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:41 user nova-compute[71206]: WARNING nova.compute.manager [req-0b718341-a7e1-4f6a-bcfd-544c1dda349a req-7e2e6f1d-c58b-4083-914b-f899488e0063 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state active and task_state reboot_started_hard.
Jul 27 18:21:42 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26666316331356530', 'path': '/dev/sde'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666316331356530', 'path': '/dev/sde'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:21:39Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'pci_devices' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:21:42 user nova-compute[71206]:   <uuid>f606f8e4-7da8-4d29-9098-245d114cec8b</uuid>
Jul 27 18:21:42 user nova-compute[71206]:   <name>instance-0000002a</name>
Jul 27 18:21:42 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:21:42 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:21:42 user nova-compute[71206]:   <metadata>
Jul 27 18:21:42 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:21:42 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:name>tempest-TestMinimumBasicScenario-server-488649459</nova:name>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:21:40</nova:creationTime>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:21:42 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:21:42 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:owner>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:user uuid="671f2aec0ab2455cb24e10f5c726ecbb">tempest-TestMinimumBasicScenario-197547931-project-member</nova:user>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:project uuid="2a70697714134b96873b86f84ef10ffc">tempest-TestMinimumBasicScenario-197547931</nova:project>
Jul 27 18:21:42 user nova-compute[71206]:       </nova:owner>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:root type="image" uuid="e4fd959f-93e5-4b84-b0c6-ce0307c9a366"/>
Jul 27 18:21:42 user nova-compute[71206]:       <nova:ports>
Jul 27 18:21:42 user nova-compute[71206]:         <nova:port uuid="36e87352-0e48-4211-9bdc-783431f2215b">
Jul 27 18:21:42 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:21:42 user nova-compute[71206]:         </nova:port>
Jul 27 18:21:42 user nova-compute[71206]:       </nova:ports>
Jul 27 18:21:42 user nova-compute[71206]:     </nova:instance>
Jul 27 18:21:42 user nova-compute[71206]:   </metadata>
Jul 27 18:21:42 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:21:42 user nova-compute[71206]:     <system>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="serial">f606f8e4-7da8-4d29-9098-245d114cec8b</entry>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="uuid">f606f8e4-7da8-4d29-9098-245d114cec8b</entry>
Jul 27 18:21:42 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:21:42 user nova-compute[71206]:     </system>
Jul 27 18:21:42 user nova-compute[71206]:   </sysinfo>
Jul 27 18:21:42 user nova-compute[71206]:   <os>
Jul 27 18:21:42 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:21:42 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:21:42 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:21:42 user nova-compute[71206]:   </os>
Jul 27 18:21:42 user nova-compute[71206]:   <features>
Jul 27 18:21:42 user nova-compute[71206]:     <acpi/>
Jul 27 18:21:42 user nova-compute[71206]:     <apic/>
Jul 27 18:21:42 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:21:42 user nova-compute[71206]:   </features>
Jul 27 18:21:42 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:21:42 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:21:42 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:21:42 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:21:42 user nova-compute[71206]:   </clock>
Jul 27 18:21:42 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:21:42 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:21:42 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:21:42 user nova-compute[71206]:   </cpu>
Jul 27 18:21:42 user nova-compute[71206]:   <devices>
Jul 27 18:21:42 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:21:42 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:21:42 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk"/>
Jul 27 18:21:42 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:21:42 user nova-compute[71206]:     </disk>
Jul 27 18:21:42 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:21:42 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:21:42 user nova-compute[71206]:       <source dev="/dev/sde"/>
Jul 27 18:21:42 user nova-compute[71206]:       <target dev="vdb" bus="virtio"/>
Jul 27 18:21:42 user nova-compute[71206]:       <serial>dbaed406-7b7a-41e4-a356-fa9bd9e1ea11</serial>
Jul 27 18:21:42 user nova-compute[71206]:     </disk>
Jul 27 18:21:42 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:21:42 user nova-compute[71206]:       <mac address="fa:16:3e:c9:de:8f"/>
Jul 27 18:21:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:21:42 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:21:42 user nova-compute[71206]:       <target dev="tap36e87352-0e"/>
Jul 27 18:21:42 user nova-compute[71206]:     </interface>
Jul 27 18:21:42 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:21:42 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/console.log" append="off"/>
Jul 27 18:21:42 user nova-compute[71206]:     </serial>
Jul 27 18:21:42 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:21:42 user nova-compute[71206]:     <video>
Jul 27 18:21:42 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:21:42 user nova-compute[71206]:     </video>
Jul 27 18:21:42 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:21:42 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:21:42 user nova-compute[71206]:     </rng>
Jul 27 18:21:42 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:21:42 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:21:42 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:21:42 user nova-compute[71206]:     </memballoon>
Jul 27 18:21:42 user nova-compute[71206]:   </devices>
Jul 27 18:21:42 user nova-compute[71206]: </domain>
Jul 27 18:21:42 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'trusted_certs' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Cannot resize image /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'migration_context' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:21:39Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG os_vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36e87352-0e, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36e87352-0e, col_values=(('external_ids', {'iface-id': '36e87352-0e48-4211-9bdc-783431f2215b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:de:8f', 'vm-uuid': 'f606f8e4-7da8-4d29-9098-245d114cec8b'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:42 user nova-compute[71206]: INFO os_vif [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e')
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:46 user nova-compute[71206]: WARNING nova.compute.manager [req-91a101b6-3e51-49f3-a50f-09c69df026ad req-f5d459f4-122c-4875-abb9-853db0d8d9eb service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state active and task_state reboot_started_hard.
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:46 user nova-compute[71206]: WARNING nova.compute.manager [req-e8343d9a-d119-4e45-864d-20bab0ea4910 req-dc8b8c4c-edf5-48f7-91d1-3188a5de20b0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state active and task_state reboot_started_hard.
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for f606f8e4-7da8-4d29-9098-245d114cec8b due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482106.3831034, f606f8e4-7da8-4d29-9098-245d114cec8b => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:21:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] VM Resumed (Lifecycle Event)
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:21:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:21:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.133113861083984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:46 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance rebooted successfully.
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:21:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482106.3839736, f606f8e4-7da8-4d29-9098-245d114cec8b => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:21:46 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] VM Started (Lifecycle Event)
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9ef348d8-5702-4920-8efd-613b1623c95f tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.079s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7a3a1a62-0246-475c-b346-35aab836bf84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance a9ee747d-0e26-4db1-be46-b31318ffa30d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 3e5847a2-1036-49e3-b657-69476f8becce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f606f8e4-7da8-4d29-9098-245d114cec8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 15c417e8-afda-473d-aa18-32014a65ef6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:21:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:21:47 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:21:47 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:21:47 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:21:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-changed-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing instance network info cache due to event network-changed-da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:21:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] Acquiring lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] Acquired lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing network info cache for port da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updated VIF entry in instance network info cache for port da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating instance_info_cache with network_info: [{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ea7c200a-3e98-40df-9dcd-30a406edead4 req-6387ecc8-62e0-443d-9b92-39365e537483 service nova] Releasing lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-changed-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing instance network info cache due to event network-changed-da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] Acquiring lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] Acquired lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.network.neutron [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Refreshing network info cache for port da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:49 user nova-compute[71206]: INFO nova.compute.manager [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Terminating instance
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:50 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Instance destroyed successfully.
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.objects.instance [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid 15c417e8-afda-473d-aa18-32014a65ef6b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1751245101',display_name='tempest-TestVolumeBootPattern-server-1751245101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1751245101',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:20:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-p00lu405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:20:09Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=15c417e8-afda-473d-aa18-32014a65ef6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_vif [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda043afd-74, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:50 user nova-compute[71206]: INFO os_vif [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:0f:04,bridge_name='br-int',has_traffic_filtering=True,id=da043afd-7439-4b0d-816d-a516935af84f,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda043afd-74')
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DruhQVwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:21:50 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e088d52d-9f96-40a3-9a53-0626196f2f3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:21:50 user nova-compute[71206]: No targets found.
Jul 27 18:21:50 user nova-compute[71206]: iSNS:
Jul 27 18:21:50 user nova-compute[71206]: No targets found.
Jul 27 18:21:50 user nova-compute[71206]: STATIC:
Jul 27 18:21:50 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:21:50 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:50 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:50 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f
Jul 27 18:21:50 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:50 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:50 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:21:50 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:50 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:50 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:21:50 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:21:50 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:21:50 user nova-compute[71206]: FIRMWARE:
Jul 27 18:21:50 user nova-compute[71206]: No targets found.
Jul 27 18:21:50 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:21:50 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:21:50 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38748352-a192-4f98-aadf-95308040395c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[194c176a-90d0-412a-ae9f-3b9a1b8abfd1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f (non-flash)
Jul 27 18:21:50 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:21:50 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c2c01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d447c2-c40c-4fe8-b240-4844357fa4a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fcf5b1-48b6-4861-bc9a-d6b2f691e7f6]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a0a5b3-227b-4c53-9ac1-17fa22392523]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f913dddd-9324-4dbe-9386-8e6ea21800c9]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce22bcc-7f53-456d-ae99-bad264d403b4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9501a27-2e9d-42ca-a0a1-61327afe69f6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260]
Jul 27 18:21:50 user nova-compute[71206]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f, portal: 172.16.0.220,3260] successful.
Jul 27 18:21:50 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33b303b2-b8d3-43d3-9186-87fb0dfb442f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[310bb6ee-9402-4133-a3fa-ba69b7a4a980]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (341ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:21:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:21:50 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Deleting instance files /opt/stack/data/nova/instances/15c417e8-afda-473d-aa18-32014a65ef6b_del
Jul 27 18:21:50 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Deletion of /opt/stack/data/nova/instances/15c417e8-afda-473d-aa18-32014a65ef6b_del complete
Jul 27 18:21:51 user nova-compute[71206]: INFO nova.compute.manager [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Took 1.67 seconds to destroy the instance on the hypervisor.
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-unplugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] No waiting events found dispatching network-vif-unplugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-unplugged-da043afd-7439-4b0d-816d-a516935af84f for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Acquiring lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] Lock "15c417e8-afda-473d-aa18-32014a65ef6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] No waiting events found dispatching network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:51 user nova-compute[71206]: WARNING nova.compute.manager [req-d637be53-6338-42f7-9685-b720a3cc2c21 req-498817a6-22e0-49ff-8fe2-fdba77293876 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received unexpected event network-vif-plugged-da043afd-7439-4b0d-816d-a516935af84f for instance with vm_state active and task_state deleting.
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:51 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Took 0.50 seconds to deallocate network for instance.
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-a805ce80-aacb-4204-8c33-742ca127b256 req-4be4a3d3-005b-44f7-ad5e-5cb34d52b106 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Received event network-vif-deleted-da043afd-7439-4b0d-816d-a516935af84f {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updated VIF entry in instance network info cache for port da043afd-7439-4b0d-816d-a516935af84f. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Updating instance_info_cache with network_info: [{"id": "da043afd-7439-4b0d-816d-a516935af84f", "address": "fa:16:3e:bb:0f:04", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda043afd-74", "ovs_interfaceid": "da043afd-7439-4b0d-816d-a516935af84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5adf8b53-69b8-446d-af96-7c7aff6d43bf req-942ca639-545a-4db2-88c1-62f1382692d1 service nova] Releasing lock "refresh_cache-15c417e8-afda-473d-aa18-32014a65ef6b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-changed-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing instance network info cache due to event network-changed-0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] Acquiring lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] Acquired lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.network.neutron [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Refreshing network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:51 user nova-compute[71206]: INFO nova.compute.manager [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Terminating instance
Jul 27 18:21:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updated VIF entry in instance network info cache for port 0b27c06c-e847-4244-94b7-8e498529541d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.network.neutron [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating instance_info_cache with network_info: [{"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f94fe533-93fa-40a1-bfe5-67b4d5e16169 req-c9a329c3-333a-406e-8d19-a98f0bd9fda8 service nova] Releasing lock "refresh_cache-a9ee747d-0e26-4db1-be46-b31318ffa30d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.compute.manager [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Took 0.96 seconds to detach 1 volumes for instance.
Jul 27 18:21:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Instance destroyed successfully.
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'resources' on Instance uuid a9ee747d-0e26-4db1-be46-b31318ffa30d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-69542338',display_name='tempest-TestStampPattern-server-69542338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-69542338',id=39,image_ref='95404822-5ce2-4ee2-ac76-087d297878ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-b4ay0h6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='74f56d44-bada-4942-b47d-a0312ce2dc97',image_min_disk='1',image_min_ram='0',image_owner_id='090bd6fa83a744c1976f04ce4c03e159',image_owner_project_name='tempest-TestStampPattern-685676605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-685676605-project-member',image_user_id='450fa830059c43e79f2cf7ca9d209d76',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:05Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=a9ee747d-0e26-4db1-be46-b31318ffa30d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "0b27c06c-e847-4244-94b7-8e498529541d", "address": "fa:16:3e:06:f2:d7", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b27c06c-e8", "ovs_interfaceid": "0b27c06c-e847-4244-94b7-8e498529541d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG os_vif [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b27c06c-e8, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:21:52 user nova-compute[71206]: INFO os_vif [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=0b27c06c-e847-4244-94b7-8e498529541d,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b27c06c-e8')
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Deleting instance files /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d_del
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Deletion of /opt/stack/data/nova/instances/a9ee747d-0e26-4db1-be46-b31318ffa30d_del complete
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.compute.manager [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 18:21:52 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:21:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:52 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance 15c417e8-afda-473d-aa18-32014a65ef6b
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-aa399334-1fea-466d-a12b-90aa511bfbfd tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "15c417e8-afda-473d-aa18-32014a65ef6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.704s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-unplugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] No waiting events found dispatching network-vif-unplugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-unplugged-0b27c06c-e847-4244-94b7-8e498529541d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Acquiring lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] No waiting events found dispatching network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:21:53 user nova-compute[71206]: WARNING nova.compute.manager [req-ee0764b5-3891-4efb-8d9e-3bda1900e680 req-e18ae680-af81-4925-90aa-02c7eed05ad8 service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received unexpected event network-vif-plugged-0b27c06c-e847-4244-94b7-8e498529541d for instance with vm_state active and task_state deleting.
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:21:53 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Took 0.62 seconds to deallocate network for instance.
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-04c85131-20da-4c9c-9087-c0bee4fc423b req-86f6d0f0-028c-47bf-904e-b1124af58eaf service nova] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Received event network-vif-deleted-0b27c06c-e847-4244-94b7-8e498529541d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:53 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Deleted allocations for instance a9ee747d-0e26-4db1-be46-b31318ffa30d
Jul 27 18:21:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f50bb89e-3cbc-40e9-af4e-e783e17d4bc1 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "a9ee747d-0e26-4db1-be46-b31318ffa30d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:21:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:03 user nova-compute[71206]: INFO nova.compute.manager [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Terminating instance
Jul 27 18:22:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-unplugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] No waiting events found dispatching network-vif-unplugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-184799bf-cc47-4b87-9589-8b1cc3242ef1 req-dc157a0e-819f-4d07-8863-8b0fc0c4a829 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-unplugged-24be62b7-60b7-4739-9266-4e10c907e53c for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Instance destroyed successfully.
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.objects.instance [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lazy-loading 'resources' on Instance uuid 3e5847a2-1036-49e3-b657-69476f8becce {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-603273058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6032730',id=40,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGOMvfXphj7DSIMU6VKl25CrZlvSKtu3WAdX59XrTO7xskWP/ae1IlYVZRrIVClsT4YtGJcTkyRgMWCLTIj6hgXJYwx5D32BehoyaHtpFKdqBHq/Ju8q2B5VSGFMj+dQ==',key_name='tempest-keypair-1969425332',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19bf2ce16ee948f7b5af721b5645ec2e',ramdisk_id='',reservation_id='r-1mkk6961',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:19:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='618d118495f9473ea0b8b2f605b5dc1a',uuid=3e5847a2-1036-49e3-b657-69476f8becce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converting VIF {"id": "24be62b7-60b7-4739-9266-4e10c907e53c", "address": "fa:16:3e:03:18:e0", "network": {"id": "45ad2425-0acd-4c38-8864-83cbfd8b543d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485753225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19bf2ce16ee948f7b5af721b5645ec2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be62b7-60", "ovs_interfaceid": "24be62b7-60b7-4739-9266-4e10c907e53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG os_vif [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24be62b7-60, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:22:04 user nova-compute[71206]: INFO os_vif [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:18:e0,bridge_name='br-int',has_traffic_filtering=True,id=24be62b7-60b7-4739-9266-4e10c907e53c,network=Network(45ad2425-0acd-4c38-8864-83cbfd8b543d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be62b7-60')
Jul 27 18:22:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Deleting instance files /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce_del
Jul 27 18:22:04 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Deletion of /opt/stack/data/nova/instances/3e5847a2-1036-49e3-b657-69476f8becce_del complete
Jul 27 18:22:04 user nova-compute[71206]: INFO nova.compute.manager [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 27 18:22:04 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:22:04 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482110.5568564, 15c417e8-afda-473d-aa18-32014a65ef6b => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:22:05 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] VM Stopped (Lifecycle Event)
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-005dccd9-d379-4d8c-bb31-5d988cf9b517 None None] [instance: 15c417e8-afda-473d-aa18-32014a65ef6b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:05 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Took 0.96 seconds to deallocate network for instance.
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-e226dde2-6004-45d7-9ef2-7830f6f10576 req-1a97402c-a24b-457c-a100-92700b6444c7 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-deleted-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:05 user nova-compute[71206]: INFO nova.compute.manager [req-e226dde2-6004-45d7-9ef2-7830f6f10576 req-1a97402c-a24b-457c-a100-92700b6444c7 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Neutron deleted interface 24be62b7-60b7-4739-9266-4e10c907e53c; detaching it from the instance and deleting it from the info cache
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.network.neutron [req-e226dde2-6004-45d7-9ef2-7830f6f10576 req-1a97402c-a24b-457c-a100-92700b6444c7 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:05 user nova-compute[71206]: DEBUG nova.compute.manager [req-e226dde2-6004-45d7-9ef2-7830f6f10576 req-1a97402c-a24b-457c-a100-92700b6444c7 service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Detach interface failed, port_id=24be62b7-60b7-4739-9266-4e10c907e53c, reason: Instance 3e5847a2-1036-49e3-b657-69476f8becce could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:22:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:06 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Deleted allocations for instance 3e5847a2-1036-49e3-b657-69476f8becce
Jul 27 18:22:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-886e11ba-2cf6-4f08-9bd4-3aa064f44414 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259 tempest-TestServerVolumeAttachScenarioOldVersion-1721484259-project-member] Lock "3e5847a2-1036-49e3-b657-69476f8becce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] Acquiring lock "3e5847a2-1036-49e3-b657-69476f8becce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] Lock "3e5847a2-1036-49e3-b657-69476f8becce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] No waiting events found dispatching network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:06 user nova-compute[71206]: WARNING nova.compute.manager [req-407d6593-f68b-4cb1-877c-8067158c0647 req-9ece15b5-6c0d-4960-a124-9c23ad4d92fb service nova] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Received unexpected event network-vif-plugged-24be62b7-60b7-4739-9266-4e10c907e53c for instance with vm_state deleted and task_state None.
Jul 27 18:22:07 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482112.614821, a9ee747d-0e26-4db1-be46-b31318ffa30d => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:22:07 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] VM Stopped (Lifecycle Event)
Jul 27 18:22:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-5e68800e-93e9-4577-bb80-15d7ea43fdaa None None] [instance: a9ee747d-0e26-4db1-be46-b31318ffa30d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-changed-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG nova.compute.manager [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Refreshing instance network info cache due to event network-changed-7f47df03-4059-4d8e-9bd4-bf393e2d9a46. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] Acquiring lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] Acquired lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG nova.network.neutron [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Refreshing network info cache for port 7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG nova.network.neutron [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updated VIF entry in instance network info cache for port 7f47df03-4059-4d8e-9bd4-bf393e2d9a46. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG nova.network.neutron [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:11 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0c12026f-ece3-4332-9efc-fcdb8454d029 req-7355c3d9-f960-4dce-9703-51ca8acb38f2 service nova] Releasing lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG nova.objects.instance [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:14 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:15 user nova-compute[71206]: INFO nova.compute.manager [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Attaching volume c03c3a35-9477-4c0b-8248-89b85437c7fb to /dev/vdb
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.utils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2527e-be27-42f1-95b0-c91913099647]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4e6a9-01db-4be1-a686-a22e32870354]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c2946-e5b3-4a8e-9061-b676fc6fb898]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc4b22-c7b4-45f4-822d-c9e3810b3240]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:22:15 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:22:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f2897-4a63-4d17-818d-964b7a15cd48]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG os_brick.utils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:22:15 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating existing volume attachment record: cb236ab4-7847-42f0-af7b-621dee6a1d32 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:22:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:19 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482124.567971, 3e5847a2-1036-49e3-b657-69476f8becce => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:22:19 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] VM Stopped (Lifecycle Event)
Jul 27 18:22:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-72fc9eda-4143-4310-a9b1-fe303a0571f4 None None] [instance: 3e5847a2-1036-49e3-b657-69476f8becce] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkBEfyiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:22:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:22:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:22:22 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c53a42-1e2d-421f-b582-be5739248da3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:22:22 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f8391c-cc69-4a45-9e6b-4f20e4adf9b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb] added
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7d342-0289-43a8-966e-236260d208f4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b591f958-11af-404d-9537-d798e1eaa869]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkBEfyiH {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkBEfyiH" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46cf0a-721e-4fd1-b00f-33370ec8c8ea]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wkBEfyiH'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ecb75-4a46-49d4-a7e5-83e784014dc5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52d137-4e5d-48b9-91fb-8e22fb77f974]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc92f1f-1045-49a3-8bfc-d81763acfb63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260]
Jul 27 18:22:22 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260] successful.
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e49685-8276-4539-8db2-b36586930c21]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9838da-fc47-4730-86ea-c1363a431f39]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:22 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0656898-fd67-4a81-a347-390d73652fe0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkBEfyiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23864616661386366', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864616661386366', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:22:23 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:22:23 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:22:23 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:22:23 user nova-compute[71206]:   <serial>c03c3a35-9477-4c0b-8248-89b85437c7fb</serial>
Jul 27 18:22:23 user nova-compute[71206]: </disk>
Jul 27 18:22:23 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:96:91:bc, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:22:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-707088cb-860a-4845-828f-e87b503a92b1 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.884s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:22:27 user nova-compute[71206]: INFO nova.compute.claims [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Claim successful on node user
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:22:27 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:22:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.policy [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fb2e64d76d4952aed3839301da9af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d53f91aae484d95bb2a977e07116238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:22:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Creating image(s)
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk 1073741824" returned: 0 in 0.064s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Cannot resize image /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'migration_context' on Instance uuid ea7a90fc-9831-47f3-a56c-0fc851c78317 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Ensure instance console log exists: /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:28 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Successfully created port: 7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Successfully updated port: 7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquired lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-changed-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Refreshing instance network info cache due to event network-changed-7a7a7221-f255-4586-b467-66ad030c57fc. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] Acquiring lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:29 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updating instance_info_cache with network_info: [{"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Releasing lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Instance network_info: |[{"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] Acquired lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Refreshing network info cache for port 7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Start _get_guest_xml network_info=[{"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:22:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:22:30 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347545339',display_name='tempest-AttachVolumeNegativeTest-server-1347545339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347545339',id=46,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/G5IvQiBYyQ8N7fGBU3++NDiuU18UK6YGlgQN5oxiAUIOSmnVhBAClWE5qNrym8KG9aA8OocOIwCadh1uN5vPV58QcnvYuuMcoYAR9IpJxKSGDZNRs7A8RoPrxwc439A==',key_name='tempest-keypair-1393022180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-428sma1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=ea7a90fc-9831-47f3-a56c-0fc851c78317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'pci_devices' on Instance uuid ea7a90fc-9831-47f3-a56c-0fc851c78317 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:22:30 user nova-compute[71206]:   <uuid>ea7a90fc-9831-47f3-a56c-0fc851c78317</uuid>
Jul 27 18:22:30 user nova-compute[71206]:   <name>instance-0000002e</name>
Jul 27 18:22:30 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:22:30 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:22:30 user nova-compute[71206]:   <metadata>
Jul 27 18:22:30 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:22:30 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1347545339</nova:name>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:22:30</nova:creationTime>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:22:30 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:22:30 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:owner>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:user uuid="75fb2e64d76d4952aed3839301da9af9">tempest-AttachVolumeNegativeTest-1298407279-project-member</nova:user>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:project uuid="9d53f91aae484d95bb2a977e07116238">tempest-AttachVolumeNegativeTest-1298407279</nova:project>
Jul 27 18:22:30 user nova-compute[71206]:       </nova:owner>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:22:30 user nova-compute[71206]:       <nova:ports>
Jul 27 18:22:30 user nova-compute[71206]:         <nova:port uuid="7a7a7221-f255-4586-b467-66ad030c57fc">
Jul 27 18:22:30 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 18:22:30 user nova-compute[71206]:         </nova:port>
Jul 27 18:22:30 user nova-compute[71206]:       </nova:ports>
Jul 27 18:22:30 user nova-compute[71206]:     </nova:instance>
Jul 27 18:22:30 user nova-compute[71206]:   </metadata>
Jul 27 18:22:30 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:22:30 user nova-compute[71206]:     <system>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="serial">ea7a90fc-9831-47f3-a56c-0fc851c78317</entry>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="uuid">ea7a90fc-9831-47f3-a56c-0fc851c78317</entry>
Jul 27 18:22:30 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:22:30 user nova-compute[71206]:     </system>
Jul 27 18:22:30 user nova-compute[71206]:   </sysinfo>
Jul 27 18:22:30 user nova-compute[71206]:   <os>
Jul 27 18:22:30 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:22:30 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:22:30 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:22:30 user nova-compute[71206]:   </os>
Jul 27 18:22:30 user nova-compute[71206]:   <features>
Jul 27 18:22:30 user nova-compute[71206]:     <acpi/>
Jul 27 18:22:30 user nova-compute[71206]:     <apic/>
Jul 27 18:22:30 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:22:30 user nova-compute[71206]:   </features>
Jul 27 18:22:30 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:22:30 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:22:30 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:22:30 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:22:30 user nova-compute[71206]:   </clock>
Jul 27 18:22:30 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:22:30 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:22:30 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:22:30 user nova-compute[71206]:   </cpu>
Jul 27 18:22:30 user nova-compute[71206]:   <devices>
Jul 27 18:22:30 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:22:30 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:22:30 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk"/>
Jul 27 18:22:30 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:22:30 user nova-compute[71206]:     </disk>
Jul 27 18:22:30 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:22:30 user nova-compute[71206]:       <mac address="fa:16:3e:5e:bb:24"/>
Jul 27 18:22:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:22:30 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:22:30 user nova-compute[71206]:       <target dev="tap7a7a7221-f2"/>
Jul 27 18:22:30 user nova-compute[71206]:     </interface>
Jul 27 18:22:30 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:22:30 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/console.log" append="off"/>
Jul 27 18:22:30 user nova-compute[71206]:     </serial>
Jul 27 18:22:30 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:22:30 user nova-compute[71206]:     <video>
Jul 27 18:22:30 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:22:30 user nova-compute[71206]:     </video>
Jul 27 18:22:30 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:22:30 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:22:30 user nova-compute[71206]:     </rng>
Jul 27 18:22:30 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:22:30 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:22:30 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:22:30 user nova-compute[71206]:     </memballoon>
Jul 27 18:22:30 user nova-compute[71206]:   </devices>
Jul 27 18:22:30 user nova-compute[71206]: </domain>
Jul 27 18:22:30 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347545339',display_name='tempest-AttachVolumeNegativeTest-server-1347545339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347545339',id=46,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/G5IvQiBYyQ8N7fGBU3++NDiuU18UK6YGlgQN5oxiAUIOSmnVhBAClWE5qNrym8KG9aA8OocOIwCadh1uN5vPV58QcnvYuuMcoYAR9IpJxKSGDZNRs7A8RoPrxwc439A==',key_name='tempest-keypair-1393022180',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-428sma1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=ea7a90fc-9831-47f3-a56c-0fc851c78317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG os_vif [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a7a7221-f2, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a7a7221-f2, col_values=(('external_ids', {'iface-id': '7a7a7221-f255-4586-b467-66ad030c57fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:bb:24', 'vm-uuid': 'ea7a90fc-9831-47f3-a56c-0fc851c78317'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:30 user nova-compute[71206]: INFO os_vif [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2')
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:5e:bb:24, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updated VIF entry in instance network info cache for port 7a7a7221-f255-4586-b467-66ad030c57fc. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updating instance_info_cache with network_info: [{"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-569f3ad6-0eaf-4bf2-88f6-293244874238 req-dc07a011-5c09-4204-b6ca-469673ecebae service nova] Releasing lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-changed-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG nova.compute.manager [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Refreshing instance network info cache due to event network-changed-acf2ba23-da68-4ffb-acff-fb7bf3264a9d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] Acquiring lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] Acquired lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Refreshing network info cache for port acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:31 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:32 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Ignoring supplied device name: /dev/vdb
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] No waiting events found dispatching network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:32 user nova-compute[71206]: WARNING nova.compute.manager [req-a6e9eb71-982b-4800-af22-678aa40bd226 req-3eebe96c-a305-4a76-950a-263c94e07615 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received unexpected event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc for instance with vm_state building and task_state spawning.
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:32 user nova-compute[71206]: INFO nova.compute.manager [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Attaching volume ca082cf8-9a19-442a-b2b8-569b7f0f3b81 to /dev/vdb
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.utils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1c54f-d275-4e55-97c8-021aff6f9023]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG nova.network.neutron [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updated VIF entry in instance network info cache for port acf2ba23-da68-4ffb-acff-fb7bf3264a9d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG nova.network.neutron [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating instance_info_cache with network_info: [{"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e2346-b0a6-4cd9-9a67-2078f603a87c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-47a6ad35-e985-4f03-8d2d-b4de897c0cc2 req-04adf53e-7cb1-482f-ae1d-92090f682b66 service nova] Releasing lock "refresh_cache-e4dc9a47-d6fe-40cd-8041-34f34843e8ec" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bc1ff2-15e0-4e94-b7e8-00a37fe27eb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71383d7-a83e-4dde-b31e-0eb77d0dc9f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:22:32 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:22:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf973b5-a15e-43cc-9b77-f052e8e3567f]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG os_brick.utils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating existing volume attachment record: 77e99966-ad28-43d0-b7bd-3daf247849f8 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:22:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482154.100883, ea7a90fc-9831-47f3-a56c-0fc851c78317 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] VM Resumed (Lifecycle Event)
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Instance spawned successfully.
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482154.1028593, ea7a90fc-9831-47f3-a56c-0fc851c78317 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] VM Started (Lifecycle Event)
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Took 6.19 seconds to spawn the instance on the hypervisor.
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] No waiting events found dispatching network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:34 user nova-compute[71206]: WARNING nova.compute.manager [req-fb1e01b1-f277-4585-8c6a-0174d52e9f4e req-91db4fa1-89b8-4217-97f5-b6822ad4d1eb service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received unexpected event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc for instance with vm_state building and task_state spawning.
Jul 27 18:22:34 user nova-compute[71206]: INFO nova.compute.manager [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Took 6.87 seconds to build instance.
Jul 27 18:22:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a171d232-22ce-4d7c-9657-b7787d881db5 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.962s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uorXQywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:22:39 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:22:39 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:22:39 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:22:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cd43e-b149-4aea-84b8-b2f9e9017793]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:22:39 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:39 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128b419-33c3-4ca3-98a7-50a0e6ab151c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81] added
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30087565-9134-4ebd-9091-d8d90bae4e44]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03a3ea0-61fa-4f18-ae74-b80b89853340]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uorXQywt {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uorXQywt" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[988f02fc-6ea9-4500-95ec-c209f5ddc319]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uorXQywt'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e6f61-0a6a-4f5a-b3f8-8f57c58e4211]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0bf437-bce1-46e7-8856-be2f0a86dfb7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6620651-f498-404f-a53d-baa27118adfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260]
Jul 27 18:22:40 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260] successful.
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a69f1-ab10-4071-901c-57d0f4d59ee4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f423c2f-11d7-4b54-a6ff-afce83d16dbc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:40 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:22:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[317839aa-78e1-4382-8884-3edf6dff9a12]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:22:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uorXQywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23637373630353462', 'path': '/dev/sdf'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373630353462', 'path': '/dev/sdf'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:22:41 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:22:41 user nova-compute[71206]:   <source dev="/dev/sdf"/>
Jul 27 18:22:41 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:22:41 user nova-compute[71206]:   <serial>ca082cf8-9a19-442a-b2b8-569b7f0f3b81</serial>
Jul 27 18:22:41 user nova-compute[71206]: </disk>
Jul 27 18:22:41 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] No VIF found with MAC fa:16:3e:d4:2c:87, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:22:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9d90a81f-2a86-4e64-ab4b-5f7e622f68c1 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.674s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:22:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=7643MB free_disk=25.14196014404297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 74f56d44-bada-4942-b47d-a0312ce2dc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 7a3a1a62-0246-475c-b346-35aab836bf84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f606f8e4-7da8-4d29-9098-245d114cec8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ea7a90fc-9831-47f3-a56c-0fc851c78317 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:22:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:22:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:22:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:22:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:22:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [{"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-0f64c63f-3a78-4f85-87d3-33590f43b5fb" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:22:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing instance network info cache due to event network-changed-6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] Acquiring lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] Acquired lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Refreshing network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:50 user nova-compute[71206]: INFO nova.compute.manager [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Terminating instance
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: INFO nova.compute.manager [None req-aa1fe230-25a6-40ee-b42c-e24895a95df5 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Get console output
Jul 27 18:22:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:50 user nova-compute[71206]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updated VIF entry in instance network info cache for port 6fe65ecf-1531-49a0-bd76-84de8b4cd914. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating instance_info_cache with network_info: [{"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0493ea25-2b93-4ba7-9a0e-3313062f81a4 req-63635a60-90f8-4819-a51d-1efc470394b2 service nova] Releasing lock "refresh_cache-7a3a1a62-0246-475c-b346-35aab836bf84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Instance destroyed successfully.
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lazy-loading 'resources' on Instance uuid 7a3a1a62-0246-475c-b346-35aab836bf84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610966681',display_name='tempest-TestVolumeBootPattern-server-1610966681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610966681',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANQNbHPmihc8pkwesaZOaj4PCTV0QtY3/emLilFnZIq3Yvqs/CIQZLi1IbsecuG+zRlxUwL05gHra458eMh9Pr1lNRnwqn3ndCoNxvDi37U3PUTh5quz7+i3nfbHgmmDg==',key_name='tempest-TestVolumeBootPattern-778672396',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea22847821f4d6d9a2a6b127ee5ce6b',ramdisk_id='',reservation_id='r-8g2p018d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1571765582',owner_user_name='tempest-TestVolumeBootPattern-1571765582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:18:06Z,user_data=None,user_id='27abded262da493aa617c1c4b3fc86ec',uuid=7a3a1a62-0246-475c-b346-35aab836bf84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converting VIF {"id": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "address": "fa:16:3e:ff:46:ae", "network": {"id": "cf69d468-e297-439c-a5f4-e1da540675be", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103481015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea22847821f4d6d9a2a6b127ee5ce6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fe65ecf-15", "ovs_interfaceid": "6fe65ecf-1531-49a0-bd76-84de8b4cd914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_vif [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fe65ecf-15, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:22:51 user nova-compute[71206]: INFO os_vif [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:46:ae,bridge_name='br-int',has_traffic_filtering=True,id=6fe65ecf-1531-49a0-bd76-84de8b4cd914,network=Network(cf69d468-e297-439c-a5f4-e1da540675be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fe65ecf-15')
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IxqVfcLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:22:51 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae24e9ca-0ed3-4799-ae52-77834ff92984]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:22:51 user nova-compute[71206]: No targets found.
Jul 27 18:22:51 user nova-compute[71206]: iSNS:
Jul 27 18:22:51 user nova-compute[71206]: No targets found.
Jul 27 18:22:51 user nova-compute[71206]: STATIC:
Jul 27 18:22:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:22:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:22:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:22:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369
Jul 27 18:22:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:22:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:22:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:22:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:22:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:22:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81
Jul 27 18:22:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:22:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:22:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:22:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:22:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:22:51 user nova-compute[71206]: FIRMWARE:
Jul 27 18:22:51 user nova-compute[71206]: No targets found.
Jul 27 18:22:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:22:51 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:22:51 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c69b58-3b17-47c9-8087-658257779545]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e90078-36d8-4022-b97b-701561e8321b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:22:51 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:22:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e241abc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9801c9c-cc2e-4ffd-831d-a5189dbe8304]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea95dd4-7e9a-45d0-8b62-e30e68470e94]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae50d6-f4e1-4407-ace5-0b8be4ce822b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79cd113-6534-4016-af04-9d3e49f816ba]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6050754e-10151ff4dbce92e3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6050754e', '/dev/disk/by-id/scsi-23130313531666634') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[882908e4-d25d-46ce-8be9-e034a1c11c58]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[792441a6-5111-401e-8e1d-b7805eb9ed4f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79699b8-0cb7-4520-9c82-59fbcfaf697c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260]
Jul 27 18:22:51 user nova-compute[71206]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369, portal: 172.16.0.220,3260] successful.
Jul 27 18:22:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1d44431-378c-4764-8a05-5290f14c5369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349f9ec-0fa6-4245-a94d-31ba54eeefb3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] <== disconnect_volume: return (338ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:22:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Deleting instance files /opt/stack/data/nova/instances/7a3a1a62-0246-475c-b346-35aab836bf84_del
Jul 27 18:22:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Deletion of /opt/stack/data/nova/instances/7a3a1a62-0246-475c-b346-35aab836bf84_del complete
Jul 27 18:22:51 user nova-compute[71206]: INFO nova.compute.manager [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 27 18:22:51 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:22:51 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:52 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Took 0.54 seconds to deallocate network for instance.
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-6424651d-52b0-4af2-84a9-13b42d348465 req-a2e7ae4a-e278-4824-a5ce-e9fa784fe6a9 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-deleted-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-unplugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] No waiting events found dispatching network-vif-unplugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-unplugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Acquiring lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] Lock "7a3a1a62-0246-475c-b346-35aab836bf84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] No waiting events found dispatching network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:52 user nova-compute[71206]: WARNING nova.compute.manager [req-5544df25-7c83-40e6-9459-d26c669bdb95 req-83266e48-15f5-46d7-b9ff-02b87e525520 service nova] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Received unexpected event network-vif-plugged-6fe65ecf-1531-49a0-bd76-84de8b4cd914 for instance with vm_state active and task_state deleting.
Jul 27 18:22:52 user nova-compute[71206]: INFO nova.compute.manager [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Took 0.71 seconds to detach 1 volumes for instance.
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:53 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Deleted allocations for instance 7a3a1a62-0246-475c-b346-35aab836bf84
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9b52bebe-22b7-4ccd-a8c6-9327359b8d14 tempest-TestVolumeBootPattern-1571765582 tempest-TestVolumeBootPattern-1571765582-project-member] Lock "7a3a1a62-0246-475c-b346-35aab836bf84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:53 user nova-compute[71206]: INFO nova.compute.manager [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Terminating instance
Jul 27 18:22:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing instance network info cache due to event network-changed-03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] Acquiring lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] Acquired lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Refreshing network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:22:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Instance destroyed successfully.
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.objects.instance [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lazy-loading 'resources' on Instance uuid 74f56d44-bada-4942-b47d-a0312ce2dc97 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-444180577',display_name='tempest-TestStampPattern-server-444180577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-444180577',id=35,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFYQjILNBiwIt8aPTeqoLGKNT/L30EJ36ljwegWI0idRvDYUfVEOq+dDGEOKbTfBV/tgpRS1G9HnXllxSwg02U7QWJNY49LyqJblnZC+RnZ+rnhHHVXifDNCnc2H3NNOw==',key_name='tempest-TestStampPattern-34042919',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6fa83a744c1976f04ce4c03e159',ramdisk_id='',reservation_id='r-nydvtnv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-685676605',owner_user_name='tempest-TestStampPattern-685676605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:18:51Z,user_data=None,user_id='450fa830059c43e79f2cf7ca9d209d76',uuid=74f56d44-bada-4942-b47d-a0312ce2dc97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converting VIF {"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG os_vif [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a1ad66-5f, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:22:54 user nova-compute[71206]: INFO os_vif [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:f0:a2,bridge_name='br-int',has_traffic_filtering=True,id=03a1ad66-5f66-4ede-82ea-05805901e268,network=Network(d38e10a1-89d6-472f-a38d-4eb84be92ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a1ad66-5f')
Jul 27 18:22:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Deleting instance files /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97_del
Jul 27 18:22:54 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Deletion of /opt/stack/data/nova/instances/74f56d44-bada-4942-b47d-a0312ce2dc97_del complete
Jul 27 18:22:54 user nova-compute[71206]: INFO nova.compute.manager [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-unplugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] No waiting events found dispatching network-vif-unplugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-unplugged-03a1ad66-5f66-4ede-82ea-05805901e268 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Acquiring lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] No waiting events found dispatching network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:22:54 user nova-compute[71206]: WARNING nova.compute.manager [req-c02a2557-da08-458f-85f4-36497488f621 req-753b1065-66bb-40bf-9e98-45a59411ed6e service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received unexpected event network-vif-plugged-03a1ad66-5f66-4ede-82ea-05805901e268 for instance with vm_state active and task_state deleting.
Jul 27 18:22:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updated VIF entry in instance network info cache for port 03a1ad66-5f66-4ede-82ea-05805901e268. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG nova.network.neutron [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [{"id": "03a1ad66-5f66-4ede-82ea-05805901e268", "address": "fa:16:3e:d3:f0:a2", "network": {"id": "d38e10a1-89d6-472f-a38d-4eb84be92ca0", "bridge": "br-int", "label": "tempest-TestStampPattern-1109921783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6fa83a744c1976f04ce4c03e159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a1ad66-5f", "ovs_interfaceid": "03a1ad66-5f66-4ede-82ea-05805901e268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7f07d9ac-dfa8-484a-a981-a4dd3a2cd2c4 req-a7a7f949-36f4-4681-bb0c-aa3a9e5bf7b1 service nova] Releasing lock "refresh_cache-74f56d44-bada-4942-b47d-a0312ce2dc97" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:22:55 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:22:55 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Took 0.85 seconds to deallocate network for instance.
Jul 27 18:22:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:22:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:22:55 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:22:55 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:22:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:55 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Deleted allocations for instance 74f56d44-bada-4942-b47d-a0312ce2dc97
Jul 27 18:22:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-23cd36e8-8426-47c4-b088-5b0782964fc3 tempest-TestStampPattern-685676605 tempest-TestStampPattern-685676605-project-member] Lock "74f56d44-bada-4942-b47d-a0312ce2dc97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:22:56 user nova-compute[71206]: DEBUG nova.compute.manager [req-857c2da2-a48f-4c28-98a7-6f916ec61379 req-9bc22454-eb50-4bfb-a40e-3fd6df42463f service nova] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Received event network-vif-deleted-03a1ad66-5f66-4ede-82ea-05805901e268 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:22:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:22:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:05 user nova-compute[71206]: INFO nova.compute.manager [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Detaching volume ca082cf8-9a19-442a-b2b8-569b7f0f3b81
Jul 27 18:23:05 user nova-compute[71206]: INFO nova.virt.block_device [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Attempting to driver detach volume ca082cf8-9a19-442a-b2b8-569b7f0f3b81 from mountpoint /dev/vdb
Jul 27 18:23:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Attempting to detach device vdb from instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:23:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:23:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:23:05 user nova-compute[71206]:   <source dev="/dev/sdf"/>
Jul 27 18:23:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:23:05 user nova-compute[71206]:   <serial>ca082cf8-9a19-442a-b2b8-569b7f0f3b81</serial>
Jul 27 18:23:05 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:23:05 user nova-compute[71206]: </disk>
Jul 27 18:23:05 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:23:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully detached device vdb from instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec from the persistent domain config.
Jul 27 18:23:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:23:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:23:05 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:23:05 user nova-compute[71206]:   <source dev="/dev/sdf"/>
Jul 27 18:23:05 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:23:05 user nova-compute[71206]:   <serial>ca082cf8-9a19-442a-b2b8-569b7f0f3b81</serial>
Jul 27 18:23:05 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:23:05 user nova-compute[71206]: </disk>
Jul 27 18:23:05 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:23:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482171.1281495, 7a3a1a62-0246-475c-b346-35aab836bf84 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:23:06 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] VM Stopped (Lifecycle Event)
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-119c0e73-88d4-40a9-bf91-3b98807aaadd None None] [instance: 7a3a1a62-0246-475c-b346-35aab836bf84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482186.3122718, e4dc9a47-d6fe-40cd-8041-34f34843e8ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:23:06 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully detached device vdb from instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec from the live domain config.
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uorXQywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:06 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e617ea1b-ecf7-4d29-b20e-967508c975ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:23:06 user nova-compute[71206]: No targets found.
Jul 27 18:23:06 user nova-compute[71206]: iSNS:
Jul 27 18:23:06 user nova-compute[71206]: No targets found.
Jul 27 18:23:06 user nova-compute[71206]: STATIC:
Jul 27 18:23:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:23:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:23:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81
Jul 27 18:23:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:06 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:23:06 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:06 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:06 user nova-compute[71206]: FIRMWARE:
Jul 27 18:23:06 user nova-compute[71206]: No targets found.
Jul 27 18:23:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:23:06 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:23:06 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d725e6-1d14-49ca-bb95-0ff79928a16c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c32a2-b665-4b55-9f5a-8f2636813d41]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:06 user nova-compute[71206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 (non-flash)
Jul 27 18:23:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c23eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81'): ({'sdf'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Removing single pathed devices sdf {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770ae5a-a8e6-4165-bb5c-7b1e603c3214]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945b575-f61e-4e06-99ef-ca0466c14065]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Flushing IO for device /dev/sdf {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ccfa7-ab2f-425e-829c-542f783debd3]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaeda76-830e-40d7-92b1-0351e5d983cb]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] SCSI volumes sdf have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b126b8-b36e-4604-9a73-88e45c10715a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38273560-d610-4a2c-ad21-861122ee27b4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260]
Jul 27 18:23:06 user nova-compute[71206]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81, portal: 172.16.0.220,3260] successful.
Jul 27 18:23:06 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426bf76-78bf-4dc8-a779-bb719aaf9d6f]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== disconnect_volume: return (325ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:06 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'flavor' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-db40d399-581f-466a-908f-bca4a6d54930 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.555s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:07 user nova-compute[71206]: INFO nova.compute.manager [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Terminating instance
Jul 27 18:23:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-unplugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] No waiting events found dispatching network-vif-unplugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-be8d7f5b-e58c-4e8f-a91a-3ba143c4cc2a req-0eae30cc-b1cf-4a54-868f-903727312f21 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-unplugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:23:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Instance destroyed successfully.
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.objects.instance [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lazy-loading 'resources' on Instance uuid e4dc9a47-d6fe-40cd-8041-34f34843e8ec {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-741658315',display_name='tempest-VolumesSnapshotTestJSON-instance-741658315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-741658315',id=45,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH61iJ1sKqfUC20ffFXOKMu2O/4/vxvexThz4YOGJNv/T4fJMBXH1zy1IWBWt4a+cdfbu/bFtMHhjLOszDnSCSAUwTpVVOxEdEohsivo9finGhDvn6W2IEsAWqyipL+SA==',key_name='tempest-keypair-793822298',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fe752f93ac64502bac3369f21987aaa',ramdisk_id='',reservation_id='r-gj6wjo4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1946142319',owner_user_name='tempest-VolumesSnapshotTestJSON-1946142319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10d22eb4c8854094911f42be4e187f08',uuid=e4dc9a47-d6fe-40cd-8041-34f34843e8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converting VIF {"id": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "address": "fa:16:3e:d4:2c:87", "network": {"id": "b86c8911-ebc1-43a8-b662-ea690e8449d1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2067430119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe752f93ac64502bac3369f21987aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf2ba23-da", "ovs_interfaceid": "acf2ba23-da68-4ffb-acff-fb7bf3264a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_vif [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacf2ba23-da, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:08 user nova-compute[71206]: INFO os_vif [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2c:87,bridge_name='br-int',has_traffic_filtering=True,id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d,network=Network(b86c8911-ebc1-43a8-b662-ea690e8449d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf2ba23-da')
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uorXQywt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:08 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[027078cb-5ee9-43a9-bbae-e8e2d2db2dd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:23:08 user nova-compute[71206]: No targets found.
Jul 27 18:23:08 user nova-compute[71206]: iSNS:
Jul 27 18:23:08 user nova-compute[71206]: No targets found.
Jul 27 18:23:08 user nova-compute[71206]: STATIC:
Jul 27 18:23:08 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:23:08 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:08 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:08 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:23:08 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:08 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:08 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:23:08 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:08 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:08 user nova-compute[71206]: FIRMWARE:
Jul 27 18:23:08 user nova-compute[71206]: No targets found.
Jul 27 18:23:08 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:23:08 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:23:08 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca082cf8-9a19-442a-b2b8-569b7f0f3b81', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96eccd-8308-44dd-9025-0fbc067c4cfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6226a96-138b-4594-99b1-c916c726a990]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:08 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:08 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:08 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:08 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:08 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:08 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e3299add0>, {}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Disconnecting from: [] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] <== disconnect_volume: return (74ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:23:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Deleting instance files /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec_del
Jul 27 18:23:08 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Deletion of /opt/stack/data/nova/instances/e4dc9a47-d6fe-40cd-8041-34f34843e8ec_del complete
Jul 27 18:23:08 user nova-compute[71206]: INFO nova.compute.manager [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 18:23:08 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:23:08 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482174.202034, 74f56d44-bada-4942-b47d-a0312ce2dc97 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:23:09 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] VM Stopped (Lifecycle Event)
Jul 27 18:23:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-81f2a62f-a41b-4915-8e4e-1060e5010d18 None None] [instance: 74f56d44-bada-4942-b47d-a0312ce2dc97] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] Acquiring lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] No waiting events found dispatching network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:09 user nova-compute[71206]: WARNING nova.compute.manager [req-fdd73bb9-3bc0-4078-a80c-bff97f41f6e4 req-231c5cf7-c28b-4419-ad58-8be814b9a35e service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received unexpected event network-vif-plugged-acf2ba23-da68-4ffb-acff-fb7bf3264a9d for instance with vm_state active and task_state deleting.
Jul 27 18:23:09 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:10 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Took 1.61 seconds to deallocate network for instance.
Jul 27 18:23:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-3ba0677c-7a15-430a-b9f7-d2d2719d2a4a req-57824eef-8855-45ab-a143-3630a41e4f36 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Received event network-vif-deleted-acf2ba23-da68-4ffb-acff-fb7bf3264a9d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:10 user nova-compute[71206]: INFO nova.compute.manager [req-3ba0677c-7a15-430a-b9f7-d2d2719d2a4a req-57824eef-8855-45ab-a143-3630a41e4f36 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Neutron deleted interface acf2ba23-da68-4ffb-acff-fb7bf3264a9d; detaching it from the instance and deleting it from the info cache
Jul 27 18:23:10 user nova-compute[71206]: DEBUG nova.network.neutron [req-3ba0677c-7a15-430a-b9f7-d2d2719d2a4a req-57824eef-8855-45ab-a143-3630a41e4f36 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:10 user nova-compute[71206]: WARNING nova.volume.cinder [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Attachment 77e99966-ad28-43d0-b7bd-3daf247849f8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 77e99966-ad28-43d0-b7bd-3daf247849f8. (HTTP 404) (Request-ID: req-280b241a-e97f-4a04-8ea3-c1af99525e54)
Jul 27 18:23:10 user nova-compute[71206]: INFO nova.compute.manager [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 18:23:10 user nova-compute[71206]: DEBUG nova.compute.manager [req-3ba0677c-7a15-430a-b9f7-d2d2719d2a4a req-57824eef-8855-45ab-a143-3630a41e4f36 service nova] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Detach interface failed, port_id=acf2ba23-da68-4ffb-acff-fb7bf3264a9d, reason: Instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:23:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:10 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:23:10 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:23:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:10 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Deleted allocations for instance e4dc9a47-d6fe-40cd-8041-34f34843e8ec
Jul 27 18:23:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-ab3a1fc0-3d04-4252-94b8-064e0b0f39b9 tempest-VolumesSnapshotTestJSON-1946142319 tempest-VolumesSnapshotTestJSON-1946142319-project-member] Lock "e4dc9a47-d6fe-40cd-8041-34f34843e8ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:15 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:23 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482188.2349193, e4dc9a47-d6fe-40cd-8041-34f34843e8ec => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:23:23 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] VM Stopped (Lifecycle Event)
Jul 27 18:23:23 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a969cd2a-bfc6-4705-a882-a41e03498dd5 None None] [instance: e4dc9a47-d6fe-40cd-8041-34f34843e8ec] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:23:24 user nova-compute[71206]: INFO nova.compute.claims [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Claim successful on node user
Jul 27 18:23:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:23:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:23:24 user nova-compute[71206]: INFO nova.virt.block_device [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Booting with volume a870ef49-1786-413b-a428-e13232fd1211 at /dev/vda
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.policy [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4fd0ce3d79b409d92663d6a29453a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7379ac88a56148ac815c4343c79ee4bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9862d5b-d845-4ed7-8663-0c0fb36f6905]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91985c0c-d95b-47e9-8aa4-af3ff303f6ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89673ba-ea1b-46e4-85ab-f45e3059eae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d47b2-2457-4a36-9571-d526840a28a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:23:24 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:23:24 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ee28a-7fa8-49d5-a77e-e5cadb5df20b]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG os_brick.utils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:24 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating existing volume attachment record: 1df0533e-0e69-4453-a7ce-254193d449a3 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:23:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Successfully created port: c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Successfully updated port: c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing instance network info cache due to event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.network.neutron [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance network_info: |[{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:23:26 user nova-compute[71206]: DEBUG nova.network.neutron [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:23:27 user nova-compute[71206]: DEBUG nova.network.neutron [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated VIF entry in instance network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:23:27 user nova-compute[71206]: DEBUG nova.network.neutron [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f34cf802-aa25-4e1b-a5ea-06812b3c7c6c req-f5bf2b91-9f34-4714-a1ab-757524243d30 service nova] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:23:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-changed-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing instance network info cache due to event network-changed-36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:23:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:23:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:23:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updated VIF entry in instance network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.network.neutron [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c33bd374-6297-4e01-8d44-93b697e01f9b req-40f20815-c5f4-4502-8022-a0b767944f4a service nova] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:31 user nova-compute[71206]: INFO nova.compute.manager [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Detaching volume dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:23:31 user nova-compute[71206]: INFO nova.virt.block_device [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Attempting to driver detach volume dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 from mountpoint /dev/vdb
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Attempting to detach device vdb from instance f606f8e4-7da8-4d29-9098-245d114cec8b from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:23:31 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:23:31 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:23:31 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:23:31 user nova-compute[71206]:   <serial>dbaed406-7b7a-41e4-a356-fa9bd9e1ea11</serial>
Jul 27 18:23:31 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:23:31 user nova-compute[71206]: </disk>
Jul 27 18:23:31 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:23:31 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully detached device vdb from instance f606f8e4-7da8-4d29-9098-245d114cec8b from the persistent domain config.
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f606f8e4-7da8-4d29-9098-245d114cec8b from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:23:31 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:23:31 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:23:31 user nova-compute[71206]:   <source dev="/dev/sde"/>
Jul 27 18:23:31 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:23:31 user nova-compute[71206]:   <serial>dbaed406-7b7a-41e4-a356-fa9bd9e1ea11</serial>
Jul 27 18:23:31 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 18:23:31 user nova-compute[71206]: </disk>
Jul 27 18:23:31 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:23:32 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Creating image(s)
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start _get_guest_xml network_info=[{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '1df0533e-0e69-4453-a7ce-254193d449a3', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6dd215bf-b46b-4d26-9169-db43d93b1f84', 'attached_at': '', 'detached_at': '', 'volume_id': 'a870ef49-1786-413b-a428-e13232fd1211', 'serial': 'a870ef49-1786-413b-a428-e13232fd1211'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:23:32 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:23:32 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:32 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a0344-c436-47c5-8232-ff2cd537f874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:23:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1ad25-7cd8-467e-a428-66a3affee5e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211] added
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c850d6f-de02-4822-87ae-90993142f0cd]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f521bd-e628-4c58-ba71-49508b7b3e99]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZFTPrgf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZFTPrgf" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6dba23-b3c5-4a41-8026-c9715a34ce67]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZFTPrgf'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d956b2-4420-479c-9ca3-d22f64df9d2a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafd11f7-caae-46a5-91b4-b54da78a90f8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482212.2305095, f606f8e4-7da8-4d29-9098-245d114cec8b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:23:32 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully detached device vdb from instance f606f8e4-7da8-4d29-9098-245d114cec8b from the live domain config.
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDjgysYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[86acb94e-fdb3-4203-a8e4-04d331cf3fe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]
Jul 27 18:23:32 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633cfaf-e048-4e70-ba9a-0ccd632f4b00]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c60978-541e-4aa8-b8d4-be2843b67e5a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:32 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca413c7-4672-409a-8bf5-00e5c4d89a78]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-changed-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.compute.manager [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing instance network info cache due to event network-changed-36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:23:32 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Refreshing network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updated VIF entry in instance network info cache for port 36e87352-0e48-4211-9bdc-783431f2215b. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.neutron [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b2fdd87c-17d2-493c-919c-d0a3f13dff0f req-79d9507d-c835-4941-b88a-4191e3ffa340 service nova] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23438326261356636', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438326261356636', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.131s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a9f6e6-e717-401b-8129-6ba4f25f60d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:23:33 user nova-compute[71206]: No targets found.
Jul 27 18:23:33 user nova-compute[71206]: iSNS:
Jul 27 18:23:33 user nova-compute[71206]: No targets found.
Jul 27 18:23:33 user nova-compute[71206]: STATIC:
Jul 27 18:23:33 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11
Jul 27 18:23:33 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:33 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:33 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:23:33 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:33 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:33 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:23:33 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:33 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:33 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:23:33 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:33 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:33 user nova-compute[71206]: FIRMWARE:
Jul 27 18:23:33 user nova-compute[71206]: No targets found.
Jul 27 18:23:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:23:33 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:23:33 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHByTdrbPvNU+FYPO7GCHIoA+gYrNi5eGFdXfKwb5kl6Wh0K8UP2nyuwGk3H2DbDjh1MWo7RilLfFzFurplP9RG03nMIVwJCuli9eIxZ5GmOnmBHaaG8y4xq2IdzIYt1Kw==',key_name='tempest-TestShelveInstance-790493354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:23:25Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:23:33 user nova-compute[71206]:   <uuid>6dd215bf-b46b-4d26-9169-db43d93b1f84</uuid>
Jul 27 18:23:33 user nova-compute[71206]:   <name>instance-0000002f</name>
Jul 27 18:23:33 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:23:33 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:23:33 user nova-compute[71206]:   <metadata>
Jul 27 18:23:33 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:23:33 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:23:33 user nova-compute[71206]:       <nova:name>tempest-TestShelveInstance-server-1620571214</nova:name>
Jul 27 18:23:33 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:23:32</nova:creationTime>
Jul 27 18:23:33 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:23:33 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:23:33 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:23:33 user nova-compute[71206]:       <nova:owner>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:user uuid="a4fd0ce3d79b409d92663d6a29453a9f">tempest-TestShelveInstance-1027914451-project-member</nova:user>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:project uuid="7379ac88a56148ac815c4343c79ee4bf">tempest-TestShelveInstance-1027914451</nova:project>
Jul 27 18:23:33 user nova-compute[71206]:       </nova:owner>
Jul 27 18:23:33 user nova-compute[71206]:       <nova:ports>
Jul 27 18:23:33 user nova-compute[71206]:         <nova:port uuid="c629fddc-5933-4f3e-b942-5cc4d8d1fded">
Jul 27 18:23:33 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:23:33 user nova-compute[71206]:         </nova:port>
Jul 27 18:23:33 user nova-compute[71206]:       </nova:ports>
Jul 27 18:23:33 user nova-compute[71206]:     </nova:instance>
Jul 27 18:23:33 user nova-compute[71206]:   </metadata>
Jul 27 18:23:33 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:23:33 user nova-compute[71206]:     <system>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="serial">6dd215bf-b46b-4d26-9169-db43d93b1f84</entry>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="uuid">6dd215bf-b46b-4d26-9169-db43d93b1f84</entry>
Jul 27 18:23:33 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:23:33 user nova-compute[71206]:     </system>
Jul 27 18:23:33 user nova-compute[71206]:   </sysinfo>
Jul 27 18:23:33 user nova-compute[71206]:   <os>
Jul 27 18:23:33 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:23:33 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:23:33 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:23:33 user nova-compute[71206]:   </os>
Jul 27 18:23:33 user nova-compute[71206]:   <features>
Jul 27 18:23:33 user nova-compute[71206]:     <acpi/>
Jul 27 18:23:33 user nova-compute[71206]:     <apic/>
Jul 27 18:23:33 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:23:33 user nova-compute[71206]:   </features>
Jul 27 18:23:33 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:23:33 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:23:33 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:23:33 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:23:33 user nova-compute[71206]:   </clock>
Jul 27 18:23:33 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:23:33 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:23:33 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:23:33 user nova-compute[71206]:   </cpu>
Jul 27 18:23:33 user nova-compute[71206]:   <devices>
Jul 27 18:23:33 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:23:33 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:23:33 user nova-compute[71206]:       <source dev="/dev/sdd"/>
Jul 27 18:23:33 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:23:33 user nova-compute[71206]:       <serial>a870ef49-1786-413b-a428-e13232fd1211</serial>
Jul 27 18:23:33 user nova-compute[71206]:     </disk>
Jul 27 18:23:33 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:23:33 user nova-compute[71206]:       <mac address="fa:16:3e:89:0a:03"/>
Jul 27 18:23:33 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:23:33 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:23:33 user nova-compute[71206]:       <target dev="tapc629fddc-59"/>
Jul 27 18:23:33 user nova-compute[71206]:     </interface>
Jul 27 18:23:33 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:23:33 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84/console.log" append="off"/>
Jul 27 18:23:33 user nova-compute[71206]:     </serial>
Jul 27 18:23:33 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:23:33 user nova-compute[71206]:     <video>
Jul 27 18:23:33 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:23:33 user nova-compute[71206]:     </video>
Jul 27 18:23:33 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:23:33 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:23:33 user nova-compute[71206]:     </rng>
Jul 27 18:23:33 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:23:33 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:23:33 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:23:33 user nova-compute[71206]:     </memballoon>
Jul 27 18:23:33 user nova-compute[71206]:   </devices>
Jul 27 18:23:33 user nova-compute[71206]: </domain>
Jul 27 18:23:33 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHByTdrbPvNU+FYPO7GCHIoA+gYrNi5eGFdXfKwb5kl6Wh0K8UP2nyuwGk3H2DbDjh1MWo7RilLfFzFurplP9RG03nMIVwJCuli9eIxZ5GmOnmBHaaG8y4xq2IdzIYt1Kw==',key_name='tempest-TestShelveInstance-790493354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:23:25Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_vif [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48daf9e-a3ac-439a-8517-eb8eeaf48738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc629fddc-59, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc629fddc-59, col_values=(('external_ids', {'iface-id': 'c629fddc-5933-4f3e-b942-5cc4d8d1fded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:0a:03', 'vm-uuid': '6dd215bf-b46b-4d26-9169-db43d93b1f84'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:33 user nova-compute[71206]: INFO os_vif [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59')
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a1248-0af4-4da8-a755-1274359a0ac0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:33 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c20a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11'): ({'sde'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Removing single pathed devices sde {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2f1f4-0080-4905-85b2-3a8acd4f237d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] No VIF found with MAC fa:16:3e:89:0a:03, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbd89d2-44a7-4b90-8d1c-b924b62ac8ea]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flushing IO for device /dev/sde {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c3c050-f27a-49b1-90f2-a675237bdf8b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d842cabc-a0bb-42f4-be66-f55f8a8548f6]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] SCSI volumes sde have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae0ce22-8665-4b3f-9be0-4a4b5436f449]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a19b2-45d5-4a2a-af1f-cd6486ab1318]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260]
Jul 27 18:23:33 user nova-compute[71206]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11, portal: 172.16.0.220,3260] successful.
Jul 27 18:23:33 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbaed406-7b7a-41e4-a356-fa9bd9e1ea11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d9364e-d42b-44e6-b2e8-21949c3f9646]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== disconnect_volume: return (1447ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG nova.objects.instance [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-eb30f9ae-c8b0-4069-a901-b61fcbf19ec8 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.112s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:34 user nova-compute[71206]: DEBUG nova.compute.manager [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:34 user nova-compute[71206]: WARNING nova.compute.manager [req-26dbadbe-b7a7-4137-9d00-5b3a64b6667c req-f2b73c89-b32e-4584-b500-acf15df7824f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state building and task_state spawning.
Jul 27 18:23:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482216.8337026, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Resumed (Lifecycle Event)
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance spawned successfully.
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482216.8385704, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Started (Lifecycle Event)
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:23:36 user nova-compute[71206]: INFO nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 27 18:23:36 user nova-compute[71206]: DEBUG nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:23:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:37 user nova-compute[71206]: WARNING nova.compute.manager [req-44d77679-dc16-4bcc-8dd8-76c258601c2d req-438efd38-5fa5-485f-9510-511d7ae7a27f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state building and task_state spawning.
Jul 27 18:23:37 user nova-compute[71206]: INFO nova.compute.manager [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Took 12.94 seconds to build instance.
Jul 27 18:23:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9a431ca6-6e36-40d2-81ed-319c42d8f744 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.038s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:40 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:42 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:43 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:23:44 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8013MB free_disk=25.2550048828125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance f606f8e4-7da8-4d29-9098-245d114cec8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance ea7a90fc-9831-47f3-a56c-0fc851c78317 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 6dd215bf-b46b-4d26-9169-db43d93b1f84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:23:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:23:46 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:23:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:49 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [{"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-f606f8e4-7da8-4d29-9098-245d114cec8b" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:23:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:23:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:51 user nova-compute[71206]: INFO nova.compute.manager [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Terminating instance
Jul 27 18:23:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.compute.manager [req-ec5dd53f-562a-4195-89ad-d570ac32ac63 req-2e7d742c-b159-46da-b0ac-4906514b8276 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-unplugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:23:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Instance destroyed successfully.
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'resources' on Instance uuid 0f64c63f-3a78-4f85-87d3-33590f43b5fb {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-346661414',display_name='tempest-ServerActionsTestOtherA-server-346661414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-346661414',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-e3p6m0ds',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=0f64c63f-3a78-4f85-87d3-33590f43b5fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "address": "fa:16:3e:4c:6c:85", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d4dbb8-05", "ovs_interfaceid": "67d4dbb8-05a2-4ae0-a4f6-c34557360b95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_vif [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d4dbb8-05, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:23:52 user nova-compute[71206]: INFO os_vif [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:6c:85,bridge_name='br-int',has_traffic_filtering=True,id=67d4dbb8-05a2-4ae0-a4f6-c34557360b95,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d4dbb8-05')
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHpjnoGh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:23:52 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2832182-48e0-4094-bdaa-f001fab05d33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:23:52 user nova-compute[71206]: No targets found.
Jul 27 18:23:52 user nova-compute[71206]: iSNS:
Jul 27 18:23:52 user nova-compute[71206]: No targets found.
Jul 27 18:23:52 user nova-compute[71206]: STATIC:
Jul 27 18:23:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:23:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0
Jul 27 18:23:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:52 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:23:52 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:23:52 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:23:52 user nova-compute[71206]: FIRMWARE:
Jul 27 18:23:52 user nova-compute[71206]: No targets found.
Jul 27 18:23:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:23:52 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:23:52 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a966211-d92b-4b12-a5dc-96cafb0aa2fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c549806-3c47-4602-a5a1-baf36a0d46a4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:52 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:52 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 (non-flash)
Jul 27 18:23:52 user nova-compute[71206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:23:52 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:23:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c209630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6297bd36-1b42-43f4-b148-16a602257237]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaae296-c399-4458-8f4e-352e0fddda95]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddae70d-6abe-40ca-b52c-41d815874230]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be503a-cfaf-4b30-bced-bd2cc90e2a39]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO970d7754-3e7171fafaf63e54', '/dev/disk/by-id/scsi-23365373137316661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_970d7754') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64a525f-229b-45af-a0f6-082b7b62782d]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5dbc3-959e-470b-b7eb-633fa839f04d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf833b6b-1cb7-4cef-b58b-16710cd76d5f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260]
Jul 27 18:23:52 user nova-compute[71206]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0, portal: 172.16.0.220,3260] successful.
Jul 27 18:23:52 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef8afa97-c884-4c6f-9659-aa4551aa79d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e1f519-4df8-41e7-8ec0-0aedaea8f902]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] <== disconnect_volume: return (343ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:23:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Deleting instance files /opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb_del
Jul 27 18:23:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Deletion of /opt/stack/data/nova/instances/0f64c63f-3a78-4f85-87d3-33590f43b5fb_del complete
Jul 27 18:23:52 user nova-compute[71206]: INFO nova.compute.manager [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 27 18:23:52 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:23:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:23:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:23:53 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:23:53 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Took 0.86 seconds to deallocate network for instance.
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] Acquiring lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] No waiting events found dispatching network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:23:54 user nova-compute[71206]: WARNING nova.compute.manager [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received unexpected event network-vif-plugged-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 for instance with vm_state active and task_state deleting.
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.compute.manager [req-afa7e23b-7926-4119-8e82-6d3b897910a7 req-9b9e117f-bf30-4b79-a29b-c3144fc0b434 service nova] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Received event network-vif-deleted-67d4dbb8-05a2-4ae0-a4f6-c34557360b95 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:23:54 user nova-compute[71206]: INFO nova.compute.manager [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Took 0.77 seconds to detach 1 volumes for instance.
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Deleting volume: ef8afa97-c884-4c6f-9659-aa4551aa79d0 {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:54 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Deleted allocations for instance 0f64c63f-3a78-4f85-87d3-33590f43b5fb
Jul 27 18:23:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bbd0bd88-9e55-4cf6-8bb3-02154fd39cde tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "0f64c63f-3a78-4f85-87d3-33590f43b5fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.481s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:23:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:23:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:07 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482232.1516285, 0f64c63f-3a78-4f85-87d3-33590f43b5fb => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:24:07 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] VM Stopped (Lifecycle Event)
Jul 27 18:24:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f8cc8206-d4af-4b2c-8727-15a3626faa04 None None] [instance: 0f64c63f-3a78-4f85-87d3-33590f43b5fb] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:24:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-changed-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG nova.compute.manager [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Refreshing instance network info cache due to event network-changed-7a7a7221-f255-4586-b467-66ad030c57fc. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] Acquiring lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] Acquired lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG nova.network.neutron [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Refreshing network info cache for port 7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG nova.network.neutron [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updated VIF entry in instance network info cache for port 7a7a7221-f255-4586-b467-66ad030c57fc. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG nova.network.neutron [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updating instance_info_cache with network_info: [{"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e80bb2f5-6df3-4e9e-819c-898ef2d1701d req-9121a093-146c-4d7d-9844-e2bb21c09c83 service nova] Releasing lock "refresh_cache-ea7a90fc-9831-47f3-a56c-0fc851c78317" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:19 user nova-compute[71206]: INFO nova.compute.manager [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Terminating instance
Jul 27 18:24:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Instance destroyed successfully.
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'resources' on Instance uuid ea7a90fc-9831-47f3-a56c-0fc851c78317 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-unplugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] No waiting events found dispatching network-vif-unplugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-unplugged-7a7a7221-f255-4586-b467-66ad030c57fc for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Acquiring lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] No waiting events found dispatching network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:20 user nova-compute[71206]: WARNING nova.compute.manager [req-e90cd83f-f7ac-4815-bc48-7744eed4950e req-019df91b-4f67-460c-b3a5-53df22ea3b6f service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received unexpected event network-vif-plugged-7a7a7221-f255-4586-b467-66ad030c57fc for instance with vm_state active and task_state deleting.
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347545339',display_name='tempest-AttachVolumeNegativeTest-server-1347545339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347545339',id=46,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/G5IvQiBYyQ8N7fGBU3++NDiuU18UK6YGlgQN5oxiAUIOSmnVhBAClWE5qNrym8KG9aA8OocOIwCadh1uN5vPV58QcnvYuuMcoYAR9IpJxKSGDZNRs7A8RoPrxwc439A==',key_name='tempest-keypair-1393022180',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-428sma1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=ea7a90fc-9831-47f3-a56c-0fc851c78317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7a7a7221-f255-4586-b467-66ad030c57fc", "address": "fa:16:3e:5e:bb:24", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7a7221-f2", "ovs_interfaceid": "7a7a7221-f255-4586-b467-66ad030c57fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG os_vif [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a7a7221-f2, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:20 user nova-compute[71206]: INFO os_vif [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:24,bridge_name='br-int',has_traffic_filtering=True,id=7a7a7221-f255-4586-b467-66ad030c57fc,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7a7221-f2')
Jul 27 18:24:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Deleting instance files /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317_del
Jul 27 18:24:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Deletion of /opt/stack/data/nova/instances/ea7a90fc-9831-47f3-a56c-0fc851c78317_del complete
Jul 27 18:24:20 user nova-compute[71206]: INFO nova.compute.manager [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Took 0.74 seconds to destroy the instance on the hypervisor.
Jul 27 18:24:20 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:24:20 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:22 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Took 1.74 seconds to deallocate network for instance.
Jul 27 18:24:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-ab939f50-6c27-44a8-971b-8e43719319fe req-94a9cc05-9fd0-4fa2-b1d9-7cb391ac313c service nova] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Received event network-vif-deleted-7a7a7221-f255-4586-b467-66ad030c57fc {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:24:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:22 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Deleted allocations for instance ea7a90fc-9831-47f3-a56c-0fc851c78317
Jul 27 18:24:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0622424-46ef-4397-8372-0770ffa97450 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "ea7a90fc-9831-47f3-a56c-0fc851c78317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.938s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:27 user nova-compute[71206]: INFO nova.compute.manager [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Terminating instance
Jul 27 18:24:27 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-36399fcb-c9c4-49ff-8970-c76ea5b41a4a req-d85d1787-8769-4428-9a70-de20f9aad344 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-unplugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Instance destroyed successfully.
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.objects.instance [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'resources' on Instance uuid f606f8e4-7da8-4d29-9098-245d114cec8b {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-488649459',display_name='tempest-TestMinimumBasicScenario-server-488649459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-488649459',id=42,image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5RJdLeFPPXV9pHzMCvtyhDF+hWUIwoAqWSNXeBnaNWVjKcTG58V2SRvBcx+sipzLSCGGtSGx3sfWprSsaQOv6g/95Jz8lIWnHhzPMcsENrUlMuoTtSI+NHL11i0nQcSQ==',key_name='tempest-TestMinimumBasicScenario-1295131408',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-e42u2t3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4fd959f-93e5-4b84-b0c6-ce0307c9a366',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:21:47Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=f606f8e4-7da8-4d29-9098-245d114cec8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "36e87352-0e48-4211-9bdc-783431f2215b", "address": "fa:16:3e:c9:de:8f", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e87352-0e", "ovs_interfaceid": "36e87352-0e48-4211-9bdc-783431f2215b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG os_vif [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36e87352-0e, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:28 user nova-compute[71206]: INFO os_vif [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:de:8f,bridge_name='br-int',has_traffic_filtering=True,id=36e87352-0e48-4211-9bdc-783431f2215b,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e87352-0e')
Jul 27 18:24:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Deleting instance files /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b_del
Jul 27 18:24:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Deletion of /opt/stack/data/nova/instances/f606f8e4-7da8-4d29-9098-245d114cec8b_del complete
Jul 27 18:24:28 user nova-compute[71206]: INFO nova.compute.manager [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 27 18:24:28 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:24:28 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:29 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Took 0.64 seconds to deallocate network for instance.
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-d402d523-a1f8-4338-bbdc-f0d0ee660efd req-36553c0b-2301-4c23-98c3-a229970a78a0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-deleted-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:29 user nova-compute[71206]: INFO nova.compute.manager [req-d402d523-a1f8-4338-bbdc-f0d0ee660efd req-36553c0b-2301-4c23-98c3-a229970a78a0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Neutron deleted interface 36e87352-0e48-4211-9bdc-783431f2215b; detaching it from the instance and deleting it from the info cache
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-d402d523-a1f8-4338-bbdc-f0d0ee660efd req-36553c0b-2301-4c23-98c3-a229970a78a0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-d402d523-a1f8-4338-bbdc-f0d0ee660efd req-36553c0b-2301-4c23-98c3-a229970a78a0 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Detach interface failed, port_id=36e87352-0e48-4211-9bdc-783431f2215b, reason: Instance f606f8e4-7da8-4d29-9098-245d114cec8b could not be found. {{(pid=71206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:24:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:29 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Deleted allocations for instance f606f8e4-7da8-4d29-9098-245d114cec8b
Jul 27 18:24:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-e8b22c20-43e0-4c6b-80a2-2e4cb9b5c473 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] Acquiring lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] Lock "f606f8e4-7da8-4d29-9098-245d114cec8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:30 user nova-compute[71206]: DEBUG nova.compute.manager [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] No waiting events found dispatching network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:30 user nova-compute[71206]: WARNING nova.compute.manager [req-1b94a49b-6db4-406a-a9a1-64201ac7d898 req-9c120cef-1f54-49b0-93d8-45494a765174 service nova] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Received unexpected event network-vif-plugged-36e87352-0e48-4211-9bdc-783431f2215b for instance with vm_state deleted and task_state None.
Jul 27 18:24:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:35 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482260.227447, ea7a90fc-9831-47f3-a56c-0fc851c78317 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:24:35 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] VM Stopped (Lifecycle Event)
Jul 27 18:24:35 user nova-compute[71206]: DEBUG nova.compute.manager [None req-e4090329-62cf-4ce5-97ce-e507f0f124a7 None None] [instance: ea7a90fc-9831-47f3-a56c-0fc851c78317] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:24:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:43 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:43 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:24:43 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482268.6221206, f606f8e4-7da8-4d29-9098-245d114cec8b => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:24:43 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] VM Stopped (Lifecycle Event)
Jul 27 18:24:43 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1ed39c6a-837b-4315-8ca0-f857d8104e45 None None] [instance: f606f8e4-7da8-4d29-9098-245d114cec8b] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:24:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:24:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:24:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:24:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8429MB free_disk=25.298503875732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d4764a2f-d9e3-40e9-933f-29374922e420 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 6dd215bf-b46b-4d26-9169-db43d93b1f84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:24:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:48 user nova-compute[71206]: INFO nova.compute.manager [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Terminating instance
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.compute.manager [req-c96519dc-58ec-4180-b4c7-db50e4b064c7 req-c57415d5-2e50-44d8-a5c1-081b4f046bb2 service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-unplugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Instance destroyed successfully.
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lazy-loading 'resources' on Instance uuid d4764a2f-d9e3-40e9-933f-29374922e420 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-853798938',display_name='tempest-ServerActionsTestOtherA-server-131161068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-853798938',id=25,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8nnH9mxjnUww87vw97AZ1Z5hO/OhfQ9/X3yKZoyDrG3Ak0fPGVdysK2C+ue2I4cCtlaNBnziZidoQ5IxOR+0UKURVWMI2zqDZ+A16/5lir76kReIFU6yvChpA5aHjHQw==',key_name='tempest-keypair-928684967',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:12:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4785a59769df4f2b8e1a027469d25d79',ramdisk_id='',reservation_id='r-x2xkn7pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-543896870',owner_user_name='tempest-ServerActionsTestOtherA-543896870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c1d017cd91d4121b90577b54b28fd89',uuid=d4764a2f-d9e3-40e9-933f-29374922e420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converting VIF {"id": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "address": "fa:16:3e:ea:3f:2d", "network": {"id": "ce7b34df-c912-46ee-96fc-a58a09a552ea", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-206330169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4785a59769df4f2b8e1a027469d25d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397c4c09-e7", "ovs_interfaceid": "397c4c09-e7b6-4e5e-a4e6-36a03f7641ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG os_vif [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397c4c09-e7, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:48 user nova-compute[71206]: INFO os_vif [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3f:2d,bridge_name='br-int',has_traffic_filtering=True,id=397c4c09-e7b6-4e5e-a4e6-36a03f7641ca,network=Network(ce7b34df-c912-46ee-96fc-a58a09a552ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397c4c09-e7')
Jul 27 18:24:48 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Deleting instance files /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420_del
Jul 27 18:24:48 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Deletion of /opt/stack/data/nova/instances/d4764a2f-d9e3-40e9-933f-29374922e420_del complete
Jul 27 18:24:48 user nova-compute[71206]: INFO nova.compute.manager [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 18:24:48 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:24:48 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:49 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Took 0.62 seconds to deallocate network for instance.
Jul 27 18:24:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-8daa167d-c1a5-49b4-803d-1ae8e405965b req-1394cd3d-3eb9-4657-8093-9a69bcb894af service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-deleted-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:49 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Deleted allocations for instance d4764a2f-d9e3-40e9-933f-29374922e420
Jul 27 18:24:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2520c3b6-2454-45d3-a856-254d6649f906 tempest-ServerActionsTestOtherA-543896870 tempest-ServerActionsTestOtherA-543896870-project-member] Lock "d4764a2f-d9e3-40e9-933f-29374922e420" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] Acquiring lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] Lock "d4764a2f-d9e3-40e9-933f-29374922e420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] No waiting events found dispatching network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:24:50 user nova-compute[71206]: WARNING nova.compute.manager [req-bca292a4-3081-47e1-a35c-c47f6d6a31b0 req-9e1cfe3f-0f3d-47bc-ba1d-94a927fafc3f service nova] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Received unexpected event network-vif-plugged-397c4c09-e7b6-4e5e-a4e6-36a03f7641ca for instance with vm_state deleted and task_state None.
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:24:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:24:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:03 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482288.7962215, d4764a2f-d9e3-40e9-933f-29374922e420 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:25:03 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] VM Stopped (Lifecycle Event)
Jul 27 18:25:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7345ea2d-9478-42c7-b069-f6b5c107c194 None None] [instance: d4764a2f-d9e3-40e9-933f-29374922e420] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:10 user nova-compute[71206]: INFO nova.compute.manager [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Detaching volume c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:25:11 user nova-compute[71206]: INFO nova.virt.block_device [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Attempting to driver detach volume c03c3a35-9477-4c0b-8248-89b85437c7fb from mountpoint /dev/vdb
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Attempting to detach device vdb from instance be45a058-3c13-4fdc-a133-9df172d9715f from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:25:11 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:25:11 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:25:11 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:25:11 user nova-compute[71206]:   <serial>c03c3a35-9477-4c0b-8248-89b85437c7fb</serial>
Jul 27 18:25:11 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:25:11 user nova-compute[71206]: </disk>
Jul 27 18:25:11 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:25:11 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance be45a058-3c13-4fdc-a133-9df172d9715f from the persistent domain config.
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be45a058-3c13-4fdc-a133-9df172d9715f from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:25:11 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:25:11 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:25:11 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:25:11 user nova-compute[71206]:   <serial>c03c3a35-9477-4c0b-8248-89b85437c7fb</serial>
Jul 27 18:25:11 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:25:11 user nova-compute[71206]: </disk>
Jul 27 18:25:11 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482311.487875, be45a058-3c13-4fdc-a133-9df172d9715f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:25:11 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance be45a058-3c13-4fdc-a133-9df172d9715f from the live domain config.
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkBEfyiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:25:11 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3587b5e8-c8d7-45c1-af4c-5399b37706d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:25:11 user nova-compute[71206]: No targets found.
Jul 27 18:25:11 user nova-compute[71206]: iSNS:
Jul 27 18:25:11 user nova-compute[71206]: No targets found.
Jul 27 18:25:11 user nova-compute[71206]: STATIC:
Jul 27 18:25:11 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:25:11 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:25:11 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:25:11 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb
Jul 27 18:25:11 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:25:11 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:25:11 user nova-compute[71206]: FIRMWARE:
Jul 27 18:25:11 user nova-compute[71206]: No targets found.
Jul 27 18:25:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:25:11 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:25:11 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0098af-a7ab-4d1d-be22-ace05384e2f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051ba8a-1b2e-46a2-a517-e282f21bfec2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:25:11 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:25:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb (non-flash)
Jul 27 18:25:11 user nova-compute[71206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:25:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e306075b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80933123-716e-4321-8583-7e380a692fc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0972c1fe-74ed-4a70-a9d9-8cb05f24171f]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0fd7ca-69b7-45ad-b7a2-cd7771780034]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f90814-9805-426a-a6f5-ab9cf3a77087]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7409d6-41d9-4192-bb22-33e80fce6b61]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5b04fa-e26f-4c89-9adc-6a2cf03f6725]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260]
Jul 27 18:25:11 user nova-compute[71206]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb, portal: 172.16.0.220,3260] successful.
Jul 27 18:25:11 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c03c3a35-9477-4c0b-8248-89b85437c7fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28127dc0-cff1-4737-991d-0151fc408f30]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== disconnect_volume: return (302ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:25:11 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:25:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:25:13 user nova-compute[71206]: DEBUG nova.objects.instance [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:13 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-9dce945d-215d-4d6c-8b6f-0e20ce26e165 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.022s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG nova.compute.manager [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing instance network info cache due to event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated VIF entry in instance network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG nova.network.neutron [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-dc64093e-7722-4855-af6b-0feb398b43db req-ab6ef4d6-1efd-4ad5-8ffe-23aff10fb44f service nova] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:18 user nova-compute[71206]: INFO nova.compute.manager [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Shelve offloading
Jul 27 18:25:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:25:19 user nova-compute[71206]: WARNING nova.compute.manager [req-a57d21fc-7b8d-49e9-96c4-d6e32699fbf7 req-b04f9ef7-dcab-422b-907b-14e4c640dcf7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state active and task_state shelving.
Jul 27 18:25:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:19 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance destroyed successfully.
Jul 27 18:25:19 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:19 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance destroyed successfully.
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'resources' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHByTdrbPvNU+FYPO7GCHIoA+gYrNi5eGFdXfKwb5kl6Wh0K8UP2nyuwGk3H2DbDjh1MWo7RilLfFzFurplP9RG03nMIVwJCuli9eIxZ5GmOnmBHaaG8y4xq2IdzIYt1Kw==',key_name='tempest-TestShelveInstance-790493354',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:23:37Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_vif [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc629fddc-59, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:25:20 user nova-compute[71206]: INFO os_vif [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59')
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.compute.manager [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing instance network info cache due to event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.network.neutron [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:25:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7423c0-d024-4f18-966d-204a4b71fcc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:25:20 user nova-compute[71206]: No targets found.
Jul 27 18:25:20 user nova-compute[71206]: iSNS:
Jul 27 18:25:20 user nova-compute[71206]: No targets found.
Jul 27 18:25:20 user nova-compute[71206]: STATIC:
Jul 27 18:25:20 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:25:20 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:25:20 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:25:20 user nova-compute[71206]: FIRMWARE:
Jul 27 18:25:20 user nova-compute[71206]: No targets found.
Jul 27 18:25:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:25:20 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:25:20 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33749284-fcce-4d4d-bf31-8b4c9717faba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452a6de-e9da-4d75-a8ec-7324a4cfa02f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:25:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:25:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c23e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa65a72e-c90e-42b8-8c9f-315fe91a3690]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2514f1-e358-4ff2-b377-b8d87755d52b]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cd3951-92ee-48d0-9b7d-e58c296bde93]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1203e1-09d2-42ce-b9c4-f9a2c6e208f5]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b26e13-4951-448e-9c09-917748850d35]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df0650-e07f-462f-b916-34d0f4b9d497]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]
Jul 27 18:25:20 user nova-compute[71206]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.
Jul 27 18:25:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da5397c-d5e6-4575-a0bd-00916a5383bc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== disconnect_volume: return (324ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:25:21 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deleting instance files /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84_del
Jul 27 18:25:21 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deletion of /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84_del complete
Jul 27 18:25:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:25:21 user nova-compute[71206]: WARNING nova.compute.manager [req-8b0fa768-d679-4a58-871d-c4b7d931f9bd req-0efed4c7-b719-40b7-bc05-88169f09b5e7 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state active and task_state shelving.
Jul 27 18:25:21 user nova-compute[71206]: DEBUG nova.network.neutron [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated VIF entry in instance network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG nova.network.neutron [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": null, "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc629fddc-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-89ad503f-918d-4926-bc71-a89f52bde637 req-c2aac453-4743-4d60-a7e2-d7657a838af8 service nova] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:21 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Deleted allocations for instance 6dd215bf-b46b-4d26-9169-db43d93b1f84
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'numa_topology' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a532319b-e07f-4227-b1bb-eaf1ae96fe32 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.449s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:25:22 user nova-compute[71206]: INFO nova.compute.claims [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Claim successful on node user
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:25:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.policy [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '671f2aec0ab2455cb24e10f5c726ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a70697714134b96873b86f84ef10ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:25:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Creating image(s)
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "/opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "/opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "/opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "403a58593f074c8b0113459b98e785cf4f33de45" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "403a58593f074c8b0113459b98e785cf4f33de45" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.part --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG nova.virt.images [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] a588d260-9b67-4193-b610-8d748b95954a was qcow2, converting to raw {{(pid=71206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG nova.privsep.utils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.part /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.converted {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Successfully created port: 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.part /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.converted" returned: 0 in 0.583s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.converted --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "403a58593f074c8b0113459b98e785cf4f33de45" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.304s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "403a58593f074c8b0113459b98e785cf4f33de45" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "403a58593f074c8b0113459b98e785cf4f33de45" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45,backing_fmt=raw /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Successfully updated port: 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.compute.manager [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing instance network info cache due to event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45,backing_fmt=raw /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk 1073741824" returned: 0 in 0.166s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "403a58593f074c8b0113459b98e785cf4f33de45" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Cannot resize image /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'migration_context' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Ensure instance console log exists: /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e179e0b5-38ab-41ab-a459-5ee16f6b8550 req-956b70bc-1824-4ccb-9650-8f2bf177fc7f service nova] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:25:24 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.network.neutron [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance network_info: |[{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Start _get_guest_xml network_info=[{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:25:19Z,direct_url=<?>,disk_format='qcow2',id=a588d260-9b67-4193-b610-8d748b95954a,min_disk=0,min_ram=0,name='tempest-scenario-img--902603872',owner='2a70697714134b96873b86f84ef10ffc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:25:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'a588d260-9b67-4193-b610-8d748b95954a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:25:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:25:25 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T18:25:19Z,direct_url=<?>,disk_format='qcow2',id=a588d260-9b67-4193-b610-8d748b95954a,min_disk=0,min_ram=0,name='tempest-scenario-img--902603872',owner='2a70697714134b96873b86f84ef10ffc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T18:25:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1850247517',display_name='tempest-TestMinimumBasicScenario-server-1850247517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1850247517',id=48,image_ref='a588d260-9b67-4193-b610-8d748b95954a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyq4NDlyQhTf8wi2hv73fQYxW5U+1Znva7YThlOCGf5H61FuYPJZZsvmVTwvyfcdzFgOzmzy+4+ZzKGrpIe9XN8hvZAPEFLx4eoyL2mdnfc2obK9qm1ApqlMhkDyH3Hwg==',key_name='tempest-TestMinimumBasicScenario-573478794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-iyytjtd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a588d260-9b67-4193-b610-8d748b95954a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:25:23Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.objects.instance [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'pci_devices' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:25:25 user nova-compute[71206]:   <uuid>d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d</uuid>
Jul 27 18:25:25 user nova-compute[71206]:   <name>instance-00000030</name>
Jul 27 18:25:25 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:25:25 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:25:25 user nova-compute[71206]:   <metadata>
Jul 27 18:25:25 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:25:25 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:name>tempest-TestMinimumBasicScenario-server-1850247517</nova:name>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:25:25</nova:creationTime>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:25:25 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:25:25 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:owner>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:user uuid="671f2aec0ab2455cb24e10f5c726ecbb">tempest-TestMinimumBasicScenario-197547931-project-member</nova:user>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:project uuid="2a70697714134b96873b86f84ef10ffc">tempest-TestMinimumBasicScenario-197547931</nova:project>
Jul 27 18:25:25 user nova-compute[71206]:       </nova:owner>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:root type="image" uuid="a588d260-9b67-4193-b610-8d748b95954a"/>
Jul 27 18:25:25 user nova-compute[71206]:       <nova:ports>
Jul 27 18:25:25 user nova-compute[71206]:         <nova:port uuid="1eb45c16-8329-400a-bdb0-64d4ca5bf9c6">
Jul 27 18:25:25 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 18:25:25 user nova-compute[71206]:         </nova:port>
Jul 27 18:25:25 user nova-compute[71206]:       </nova:ports>
Jul 27 18:25:25 user nova-compute[71206]:     </nova:instance>
Jul 27 18:25:25 user nova-compute[71206]:   </metadata>
Jul 27 18:25:25 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:25:25 user nova-compute[71206]:     <system>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="serial">d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d</entry>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="uuid">d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d</entry>
Jul 27 18:25:25 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:25:25 user nova-compute[71206]:     </system>
Jul 27 18:25:25 user nova-compute[71206]:   </sysinfo>
Jul 27 18:25:25 user nova-compute[71206]:   <os>
Jul 27 18:25:25 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:25:25 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:25:25 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:25:25 user nova-compute[71206]:   </os>
Jul 27 18:25:25 user nova-compute[71206]:   <features>
Jul 27 18:25:25 user nova-compute[71206]:     <acpi/>
Jul 27 18:25:25 user nova-compute[71206]:     <apic/>
Jul 27 18:25:25 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:25:25 user nova-compute[71206]:   </features>
Jul 27 18:25:25 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:25:25 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:25:25 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:25:25 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:25:25 user nova-compute[71206]:   </clock>
Jul 27 18:25:25 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:25:25 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:25:25 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:25:25 user nova-compute[71206]:   </cpu>
Jul 27 18:25:25 user nova-compute[71206]:   <devices>
Jul 27 18:25:25 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:25:25 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:25:25 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk"/>
Jul 27 18:25:25 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:25:25 user nova-compute[71206]:     </disk>
Jul 27 18:25:25 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:25:25 user nova-compute[71206]:       <mac address="fa:16:3e:7c:57:f7"/>
Jul 27 18:25:25 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:25:25 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:25:25 user nova-compute[71206]:       <target dev="tap1eb45c16-83"/>
Jul 27 18:25:25 user nova-compute[71206]:     </interface>
Jul 27 18:25:25 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:25:25 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/console.log" append="off"/>
Jul 27 18:25:25 user nova-compute[71206]:     </serial>
Jul 27 18:25:25 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:25:25 user nova-compute[71206]:     <video>
Jul 27 18:25:25 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:25:25 user nova-compute[71206]:     </video>
Jul 27 18:25:25 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:25:25 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:25:25 user nova-compute[71206]:     </rng>
Jul 27 18:25:25 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:25:25 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:25:25 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:25:25 user nova-compute[71206]:     </memballoon>
Jul 27 18:25:25 user nova-compute[71206]:   </devices>
Jul 27 18:25:25 user nova-compute[71206]: </domain>
Jul 27 18:25:25 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1850247517',display_name='tempest-TestMinimumBasicScenario-server-1850247517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1850247517',id=48,image_ref='a588d260-9b67-4193-b610-8d748b95954a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyq4NDlyQhTf8wi2hv73fQYxW5U+1Znva7YThlOCGf5H61FuYPJZZsvmVTwvyfcdzFgOzmzy+4+ZzKGrpIe9XN8hvZAPEFLx4eoyL2mdnfc2obK9qm1ApqlMhkDyH3Hwg==',key_name='tempest-TestMinimumBasicScenario-573478794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-iyytjtd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a588d260-9b67-4193-b610-8d748b95954a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:25:23Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG os_vif [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1eb45c16-83, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1eb45c16-83, col_values=(('external_ids', {'iface-id': '1eb45c16-8329-400a-bdb0-64d4ca5bf9c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:57:f7', 'vm-uuid': 'd105a3cf-4e36-4dc7-8ce4-ae8d33f6577d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:25 user nova-compute[71206]: INFO os_vif [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83')
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:25:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No VIF found with MAC fa:16:3e:7c:57:f7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:26 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:25:26 user nova-compute[71206]: WARNING nova.compute.manager [req-9d4c339a-536c-4bba-88bd-86d95c5fb631 req-8a0d26ab-5abd-4722-ba45-033a6002578c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state building and task_state spawning.
Jul 27 18:25:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482328.6058476, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] VM Resumed (Lifecycle Event)
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance spawned successfully.
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482328.6070132, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] VM Started (Lifecycle Event)
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:25:28 user nova-compute[71206]: WARNING nova.compute.manager [req-34d7dbe5-5883-4aca-b33c-4b596d70351b req-2ded4828-265a-458d-bfe4-b6d8cdabc699 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state building and task_state spawning.
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Took 6.15 seconds to spawn the instance on the hypervisor.
Jul 27 18:25:28 user nova-compute[71206]: DEBUG nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:28 user nova-compute[71206]: INFO nova.compute.manager [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Took 6.68 seconds to build instance.
Jul 27 18:25:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-345a78bf-99cf-495e-a252-1c91c73329b3 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.768s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:30 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:34 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482319.5391543, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:25:34 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Stopped (Lifecycle Event)
Jul 27 18:25:34 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0a8635c0-d13f-49a5-b654-3b1e603cb7d2 None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:25:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:36 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:40 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:42 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:25:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.275405883789062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance be45a058-3c13-4fdc-a133-9df172d9715f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:25:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:25:46 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:25:46 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:25:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:25:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:25:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:51 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [{"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:25:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-be45a058-3c13-4fdc-a133-9df172d9715f" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:25:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:25:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:25:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:25:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:25:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:58 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:25:58 user nova-compute[71206]: INFO nova.compute.claims [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Claim successful on node user
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:25:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.policy [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab1d522f91104d2b82563c667d798f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341a42a81d70499e9d371d96ac63d09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:25:59 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Creating image(s)
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "/opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "/opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "/opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.148s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk 1073741824" returned: 0 in 0.054s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:25:59 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Cannot resize image /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.objects.instance [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'migration_context' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Ensure instance console log exists: /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Successfully created port: 2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:26:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Successfully updated port: 2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquired lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-changed-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Refreshing instance network info cache due to event network-changed-2fbd37be-322e-47ad-bafe-8e95b843681d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] Acquiring lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:01 user nova-compute[71206]: INFO nova.compute.manager [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Terminating instance
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Releasing lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Instance network_info: |[{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] Acquired lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.neutron [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Refreshing network info cache for port 2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Start _get_guest_xml network_info=[{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:26:01 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:01 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1430635865',display_name='tempest-SnapshotDataIntegrityTests-server-1430635865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1430635865',id=49,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDZcwtBMI18lFEv4wPNX7/QOtY8O4EOO2qkoyhR0wIe9ueJskqfG9LKB8Jpmuuuv+KItuhFFLCI4Vy8NBZKyEisHPjfiJLrDTUCwGgOG7gRVsVwpJZSyHGdsHldgR2TqQ==',key_name='tempest-keypair-438331228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='341a42a81d70499e9d371d96ac63d09b',ramdisk_id='',reservation_id='r-c9arsqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-970378017',owner_user_name='tempest-SnapshotDataIntegrityTests-970378017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d522f91104d2b82563c667d798f7f',uuid=34dae52c-b14f-4d4b-a65c-236bea1f6731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converting VIF {"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.objects.instance [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'pci_devices' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-bf70f56f-fcbc-4a32-a0a7-95c108570b9c req-8d8e3305-7284-4238-ba35-d08e780f248e service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:26:01 user nova-compute[71206]:   <uuid>34dae52c-b14f-4d4b-a65c-236bea1f6731</uuid>
Jul 27 18:26:01 user nova-compute[71206]:   <name>instance-00000031</name>
Jul 27 18:26:01 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:26:01 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:26:01 user nova-compute[71206]:   <metadata>
Jul 27 18:26:01 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:26:01 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1430635865</nova:name>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:26:01</nova:creationTime>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:26:01 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:26:01 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:owner>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:user uuid="ab1d522f91104d2b82563c667d798f7f">tempest-SnapshotDataIntegrityTests-970378017-project-member</nova:user>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:project uuid="341a42a81d70499e9d371d96ac63d09b">tempest-SnapshotDataIntegrityTests-970378017</nova:project>
Jul 27 18:26:01 user nova-compute[71206]:       </nova:owner>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:26:01 user nova-compute[71206]:       <nova:ports>
Jul 27 18:26:01 user nova-compute[71206]:         <nova:port uuid="2fbd37be-322e-47ad-bafe-8e95b843681d">
Jul 27 18:26:01 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 18:26:01 user nova-compute[71206]:         </nova:port>
Jul 27 18:26:01 user nova-compute[71206]:       </nova:ports>
Jul 27 18:26:01 user nova-compute[71206]:     </nova:instance>
Jul 27 18:26:01 user nova-compute[71206]:   </metadata>
Jul 27 18:26:01 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:26:01 user nova-compute[71206]:     <system>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="serial">34dae52c-b14f-4d4b-a65c-236bea1f6731</entry>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="uuid">34dae52c-b14f-4d4b-a65c-236bea1f6731</entry>
Jul 27 18:26:01 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:26:01 user nova-compute[71206]:     </system>
Jul 27 18:26:01 user nova-compute[71206]:   </sysinfo>
Jul 27 18:26:01 user nova-compute[71206]:   <os>
Jul 27 18:26:01 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:26:01 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:26:01 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:26:01 user nova-compute[71206]:   </os>
Jul 27 18:26:01 user nova-compute[71206]:   <features>
Jul 27 18:26:01 user nova-compute[71206]:     <acpi/>
Jul 27 18:26:01 user nova-compute[71206]:     <apic/>
Jul 27 18:26:01 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:26:01 user nova-compute[71206]:   </features>
Jul 27 18:26:01 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:26:01 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:26:01 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:26:01 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:26:01 user nova-compute[71206]:   </clock>
Jul 27 18:26:01 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:26:01 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:26:01 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:26:01 user nova-compute[71206]:   </cpu>
Jul 27 18:26:01 user nova-compute[71206]:   <devices>
Jul 27 18:26:01 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:26:01 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:26:01 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk"/>
Jul 27 18:26:01 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:26:01 user nova-compute[71206]:     </disk>
Jul 27 18:26:01 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:26:01 user nova-compute[71206]:       <mac address="fa:16:3e:08:d6:7c"/>
Jul 27 18:26:01 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:26:01 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:26:01 user nova-compute[71206]:       <target dev="tap2fbd37be-32"/>
Jul 27 18:26:01 user nova-compute[71206]:     </interface>
Jul 27 18:26:01 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:26:01 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/console.log" append="off"/>
Jul 27 18:26:01 user nova-compute[71206]:     </serial>
Jul 27 18:26:01 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:26:01 user nova-compute[71206]:     <video>
Jul 27 18:26:01 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:26:01 user nova-compute[71206]:     </video>
Jul 27 18:26:01 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:26:01 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:26:01 user nova-compute[71206]:     </rng>
Jul 27 18:26:01 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:26:01 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:26:01 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:26:01 user nova-compute[71206]:     </memballoon>
Jul 27 18:26:01 user nova-compute[71206]:   </devices>
Jul 27 18:26:01 user nova-compute[71206]: </domain>
Jul 27 18:26:01 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1430635865',display_name='tempest-SnapshotDataIntegrityTests-server-1430635865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1430635865',id=49,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDZcwtBMI18lFEv4wPNX7/QOtY8O4EOO2qkoyhR0wIe9ueJskqfG9LKB8Jpmuuuv+KItuhFFLCI4Vy8NBZKyEisHPjfiJLrDTUCwGgOG7gRVsVwpJZSyHGdsHldgR2TqQ==',key_name='tempest-keypair-438331228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='341a42a81d70499e9d371d96ac63d09b',ramdisk_id='',reservation_id='r-c9arsqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-970378017',owner_user_name='tempest-SnapshotDataIntegrityTests-970378017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d522f91104d2b82563c667d798f7f',uuid=34dae52c-b14f-4d4b-a65c-236bea1f6731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converting VIF {"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG os_vif [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fbd37be-32, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fbd37be-32, col_values=(('external_ids', {'iface-id': '2fbd37be-322e-47ad-bafe-8e95b843681d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:d6:7c', 'vm-uuid': '34dae52c-b14f-4d4b-a65c-236bea1f6731'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: INFO os_vif [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32')
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No VIF found with MAC fa:16:3e:08:d6:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Instance destroyed successfully.
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'resources' on Instance uuid be45a058-3c13-4fdc-a133-9df172d9715f {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1150780681',display_name='tempest-AttachVolumeNegativeTest-server-1150780681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1150780681',id=44,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtUKVHnUUI5vCNSHYG4uWiG4FuoLvwyYH9Z2QOk8oELAevaHPhdXy9nSbdzWiAFmdSm+RwQWSDfa0RA+fRTrNYHUrw1Nh09fQ+LYshW+yQPv+JR3LUiCx+UXVjbbc9lww==',key_name='tempest-keypair-473847475',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:20:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-ott2kag9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=be45a058-3c13-4fdc-a133-9df172d9715f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "address": "fa:16:3e:96:91:bc", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f47df03-40", "ovs_interfaceid": "7f47df03-4059-4d8e-9bd4-bf393e2d9a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG os_vif [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f47df03-40, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:02 user nova-compute[71206]: INFO os_vif [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:91:bc,bridge_name='br-int',has_traffic_filtering=True,id=7f47df03-4059-4d8e-9bd4-bf393e2d9a46,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f47df03-40')
Jul 27 18:26:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Deleting instance files /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f_del
Jul 27 18:26:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Deletion of /opt/stack/data/nova/instances/be45a058-3c13-4fdc-a133-9df172d9715f_del complete
Jul 27 18:26:02 user nova-compute[71206]: INFO nova.compute.manager [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 18:26:02 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:26:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG nova.network.neutron [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updated VIF entry in instance network info cache for port 2fbd37be-322e-47ad-bafe-8e95b843681d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG nova.network.neutron [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4c7f5a98-0aef-4437-91cf-31f672086adf req-98f283a5-4818-4605-8254-87cdb80ee45e service nova] Releasing lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: WARNING nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state active and task_state deleting.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: WARNING nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state active and task_state deleting.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: WARNING nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state active and task_state deleting.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-unplugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Acquiring lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] Lock "be45a058-3c13-4fdc-a133-9df172d9715f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] No waiting events found dispatching network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: WARNING nova.compute.manager [req-e5cd1efd-73d3-4767-9603-f390bd400844 req-753e4147-ac35-413b-805e-d73bd795df84 service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received unexpected event network-vif-plugged-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 for instance with vm_state active and task_state deleting.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.manager [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] No waiting events found dispatching network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:04 user nova-compute[71206]: WARNING nova.compute.manager [req-5c73a1b2-15ff-454e-a21d-d021807102b7 req-aa36bd35-f6eb-458c-b8ad-6b365a961b8b service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received unexpected event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d for instance with vm_state building and task_state spawning.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:04 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Took 1.64 seconds to deallocate network for instance.
Jul 27 18:26:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:04 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Deleted allocations for instance be45a058-3c13-4fdc-a133-9df172d9715f
Jul 27 18:26:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-51478c8f-acd1-4aab-8ba6-9c839e3fcff6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "be45a058-3c13-4fdc-a133-9df172d9715f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.195s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Triggering sync for uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482365.861935, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] VM Resumed (Lifecycle Event)
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Instance spawned successfully.
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482365.8665125, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] VM Started (Lifecycle Event)
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:26:05 user nova-compute[71206]: INFO nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Took 6.42 seconds to spawn the instance on the hypervisor.
Jul 27 18:26:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:26:06 user nova-compute[71206]: INFO nova.compute.manager [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Took 7.17 seconds to build instance.
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-89ed327a-4f81-4079-99f5-c20ef09db87e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.271s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.448s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:06 user nova-compute[71206]: INFO nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Received event network-vif-deleted-7f47df03-4059-4d8e-9bd4-bf393e2d9a46 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:06 user nova-compute[71206]: DEBUG nova.compute.manager [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] No waiting events found dispatching network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:06 user nova-compute[71206]: WARNING nova.compute.manager [req-4e085692-153a-4cab-894d-ba1e065ad8b8 req-3c86c2e8-7298-4e8e-b528-ef19f8e39ecd service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received unexpected event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d for instance with vm_state active and task_state None.
Jul 27 18:26:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:17 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482362.6547077, be45a058-3c13-4fdc-a133-9df172d9715f => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:26:17 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] VM Stopped (Lifecycle Event)
Jul 27 18:26:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-1f613910-93d8-428c-a351-5a8a1be0b07b None None] [instance: be45a058-3c13-4fdc-a133-9df172d9715f] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:26:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:44 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:45 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=25.261272430419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:26:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:26:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:26:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:26:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:26:55 user nova-compute[71206]: INFO nova.compute.claims [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Claim successful on node user
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:26:55 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.policy [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fb2e64d76d4952aed3839301da9af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d53f91aae484d95bb2a977e07116238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:26:55 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Creating image(s)
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "/opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:55 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk 1073741824" returned: 0 in 0.051s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Cannot resize image /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.objects.instance [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'migration_context' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Ensure instance console log exists: /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:56 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Successfully created port: bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Successfully updated port: bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquired lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-changed-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.compute.manager [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Refreshing instance network info cache due to event network-changed-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] Acquiring lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.neutron [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updating instance_info_cache with network_info: [{"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Releasing lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Instance network_info: |[{"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] Acquired lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.neutron [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Refreshing network info cache for port bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Start _get_guest_xml network_info=[{"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:26:57 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:57 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-47457381',display_name='tempest-AttachVolumeNegativeTest-server-47457381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-47457381',id=50,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmJobwJMN2cCfoY7zRtUouGtXXSS5dYjgO4nqQ3/4+eH2QDAsYR3bikJB7hEaY4yG8sQPMV1ZJU2sMrwd9lBEKZdaIeWSGtK1f9pt1qdAbfM7EE0on6v0TBmE/jDnJ4hA==',key_name='tempest-keypair-1635660845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-df3fthhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=68d73977-8546-42f6-9f90-f77b6163dbbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.objects.instance [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'pci_devices' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:26:57 user nova-compute[71206]:   <uuid>68d73977-8546-42f6-9f90-f77b6163dbbd</uuid>
Jul 27 18:26:57 user nova-compute[71206]:   <name>instance-00000032</name>
Jul 27 18:26:57 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:26:57 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:26:57 user nova-compute[71206]:   <metadata>
Jul 27 18:26:57 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:26:57 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-47457381</nova:name>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:26:57</nova:creationTime>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:26:57 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:26:57 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:owner>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:user uuid="75fb2e64d76d4952aed3839301da9af9">tempest-AttachVolumeNegativeTest-1298407279-project-member</nova:user>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:project uuid="9d53f91aae484d95bb2a977e07116238">tempest-AttachVolumeNegativeTest-1298407279</nova:project>
Jul 27 18:26:57 user nova-compute[71206]:       </nova:owner>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:26:57 user nova-compute[71206]:       <nova:ports>
Jul 27 18:26:57 user nova-compute[71206]:         <nova:port uuid="bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e">
Jul 27 18:26:57 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 18:26:57 user nova-compute[71206]:         </nova:port>
Jul 27 18:26:57 user nova-compute[71206]:       </nova:ports>
Jul 27 18:26:57 user nova-compute[71206]:     </nova:instance>
Jul 27 18:26:57 user nova-compute[71206]:   </metadata>
Jul 27 18:26:57 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:26:57 user nova-compute[71206]:     <system>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="serial">68d73977-8546-42f6-9f90-f77b6163dbbd</entry>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="uuid">68d73977-8546-42f6-9f90-f77b6163dbbd</entry>
Jul 27 18:26:57 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:26:57 user nova-compute[71206]:     </system>
Jul 27 18:26:57 user nova-compute[71206]:   </sysinfo>
Jul 27 18:26:57 user nova-compute[71206]:   <os>
Jul 27 18:26:57 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:26:57 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:26:57 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:26:57 user nova-compute[71206]:   </os>
Jul 27 18:26:57 user nova-compute[71206]:   <features>
Jul 27 18:26:57 user nova-compute[71206]:     <acpi/>
Jul 27 18:26:57 user nova-compute[71206]:     <apic/>
Jul 27 18:26:57 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:26:57 user nova-compute[71206]:   </features>
Jul 27 18:26:57 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:26:57 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:26:57 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:26:57 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:26:57 user nova-compute[71206]:   </clock>
Jul 27 18:26:57 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:26:57 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:26:57 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:26:57 user nova-compute[71206]:   </cpu>
Jul 27 18:26:57 user nova-compute[71206]:   <devices>
Jul 27 18:26:57 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:26:57 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:26:57 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk"/>
Jul 27 18:26:57 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:26:57 user nova-compute[71206]:     </disk>
Jul 27 18:26:57 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:26:57 user nova-compute[71206]:       <mac address="fa:16:3e:14:65:b2"/>
Jul 27 18:26:57 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:26:57 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:26:57 user nova-compute[71206]:       <target dev="tapbb2c70d4-4f"/>
Jul 27 18:26:57 user nova-compute[71206]:     </interface>
Jul 27 18:26:57 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:26:57 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/console.log" append="off"/>
Jul 27 18:26:57 user nova-compute[71206]:     </serial>
Jul 27 18:26:57 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:26:57 user nova-compute[71206]:     <video>
Jul 27 18:26:57 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:26:57 user nova-compute[71206]:     </video>
Jul 27 18:26:57 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:26:57 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:26:57 user nova-compute[71206]:     </rng>
Jul 27 18:26:57 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:26:57 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:26:57 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:26:57 user nova-compute[71206]:     </memballoon>
Jul 27 18:26:57 user nova-compute[71206]:   </devices>
Jul 27 18:26:57 user nova-compute[71206]: </domain>
Jul 27 18:26:57 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-47457381',display_name='tempest-AttachVolumeNegativeTest-server-47457381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-47457381',id=50,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmJobwJMN2cCfoY7zRtUouGtXXSS5dYjgO4nqQ3/4+eH2QDAsYR3bikJB7hEaY4yG8sQPMV1ZJU2sMrwd9lBEKZdaIeWSGtK1f9pt1qdAbfM7EE0on6v0TBmE/jDnJ4hA==',key_name='tempest-keypair-1635660845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-df3fthhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=68d73977-8546-42f6-9f90-f77b6163dbbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG os_vif [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb2c70d4-4f, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb2c70d4-4f, col_values=(('external_ids', {'iface-id': 'bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:65:b2', 'vm-uuid': '68d73977-8546-42f6-9f90-f77b6163dbbd'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:57 user nova-compute[71206]: INFO os_vif [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f')
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:26:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:14:65:b2, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:26:58 user nova-compute[71206]: DEBUG nova.network.neutron [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updated VIF entry in instance network info cache for port bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:26:58 user nova-compute[71206]: DEBUG nova.network.neutron [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updating instance_info_cache with network_info: [{"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:26:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9c44593f-ddda-4f55-bf77-98b0371b3299 req-c9a3953e-1555-4632-a1cd-fa4a30111e3b service nova] Releasing lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG nova.compute.manager [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] No waiting events found dispatching network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:26:59 user nova-compute[71206]: WARNING nova.compute.manager [req-53bfb0b3-2b53-4894-b3f9-dda8d0f36fad req-c0d4ffcd-66a5-47dc-b37f-af4cb146ae7e service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received unexpected event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e for instance with vm_state building and task_state spawning.
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:26:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482421.2457461, 68d73977-8546-42f6-9f90-f77b6163dbbd => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] VM Resumed (Lifecycle Event)
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Instance spawned successfully.
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482421.2474506, 68d73977-8546-42f6-9f90-f77b6163dbbd => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] VM Started (Lifecycle Event)
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Took 5.61 seconds to spawn the instance on the hypervisor.
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] No waiting events found dispatching network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:01 user nova-compute[71206]: WARNING nova.compute.manager [req-7640a122-f87b-42fc-8d62-26c278559d28 req-bb59cf3c-d7d0-4fa4-b308-7156e317489c service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received unexpected event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e for instance with vm_state building and task_state spawning.
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:27:01 user nova-compute[71206]: INFO nova.compute.manager [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Took 6.19 seconds to build instance.
Jul 27 18:27:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-83f41b03-7169-461a-ab4c-13851c641b73 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.291s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:10 user nova-compute[71206]: INFO nova.compute.manager [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Unshelving
Jul 27 18:27:10 user nova-compute[71206]: INFO nova.virt.block_device [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Booting with volume a870ef49-1786-413b-a428-e13232fd1211 at /dev/vda
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.utils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eda0121-dc79-461a-b229-bbc7476a233c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94a569-428c-462f-9eed-cb526e9ba9ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12e21da-7f4b-41e2-926c-448036102eae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4415679-b18f-4f26-a3d8-2fc316bd927a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:10 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:27:10 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf262b8-8673-4749-8975-41a875f38db1]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG os_brick.utils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:27:10 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating existing volume attachment record: 48a55d41-b3b2-4ebd-be35-42f068a1562b {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:27:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:15 user nova-compute[71206]: INFO nova.compute.manager [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Attaching volume bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 to /dev/vdb
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.utils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a44947-be29-4525-8de6-bee008f103d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[513cdadc-460f-4dbc-9d31-7d729b9e0b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a0f9f-b589-4db4-9b2e-6876a614aee2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbfd490-d4f4-4221-b738-f3d0209af66e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:15 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:27:15 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddae8ed9-8816-40ed-9ed1-55773c0fd89a]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG os_brick.utils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:27:15 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating existing volume attachment record: df8b8812-bf27-46e3-b4ce-2f7796cbef42 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'pci_requests' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'numa_topology' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:27:17 user nova-compute[71206]: INFO nova.compute.claims [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Claim successful on node user
Jul 27 18:27:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:27:17 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:27:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:18 user nova-compute[71206]: INFO nova.network.neutron [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating port c629fddc-5933-4f3e-b942-5cc4d8d1fded with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 18:27:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:18 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:27:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:19 user nova-compute[71206]: DEBUG nova.compute.manager [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing instance network info cache due to event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:27:19 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:19 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:27:20 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Creating image(s)
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Did not create local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start _get_guest_xml network_info=[{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'attachment_id': '48a55d41-b3b2-4ebd-be35-42f068a1562b', 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6dd215bf-b46b-4d26-9169-db43d93b1f84', 'attached_at': '', 'detached_at': '', 'volume_id': 'a870ef49-1786-413b-a428-e13232fd1211', 'serial': 'a870ef49-1786-413b-a428-e13232fd1211'}, 'volume_type': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.network.neutron [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:27:20 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:27:20 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:27:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:27:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:27:20 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff0fd96-acae-45ba-bb30-af19f58387ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:27:20 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f6d22-1d47-4767-87e8-5b36dffc8770]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211] added
Jul 27 18:27:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d59bee-0678-4e09-b7d8-fdf3ea687f41]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8513e2e-fb68-4cf2-9568-b01a503725e5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZFTPrgf {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZFTPrgf" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b83f07-3cd7-41b1-af7b-71be409ec019]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZFTPrgf'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[460bc7ef-4d6f-4f58-9739-89f22a0f73ae]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc7f79-f02e-4d7b-9883-2a5d382e6310]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:27:20 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:27:20 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:27:20 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:27:20 user nova-compute[71206]: 
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f263d37-bb2d-470c-b274-de4a36a6752a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]
Jul 27 18:27:20 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.
Jul 27 18:27:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacb7a7-4629-4918-a24d-6a39260c51e1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d1efc6-1a63-454a-baf0-579c2c618598]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:20 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db0ced-7dac-43d7-86df-08ad45305c9c]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.network.neutron [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated VIF entry in instance network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG nova.network.neutron [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:20 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7bf97cc1-2d3d-4ba5-a77a-b7b62cda5516 req-049192f5-4a10-4e66-bf6a-889c725be2cf service nova] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23438326261356636', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438326261356636', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-790493354',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:27:11Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:27:21 user nova-compute[71206]:   <uuid>6dd215bf-b46b-4d26-9169-db43d93b1f84</uuid>
Jul 27 18:27:21 user nova-compute[71206]:   <name>instance-0000002f</name>
Jul 27 18:27:21 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:27:21 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:27:21 user nova-compute[71206]:   <metadata>
Jul 27 18:27:21 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:27:21 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:27:21 user nova-compute[71206]:       <nova:name>tempest-TestShelveInstance-server-1620571214</nova:name>
Jul 27 18:27:21 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:27:20</nova:creationTime>
Jul 27 18:27:21 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:27:21 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:27:21 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:27:21 user nova-compute[71206]:       <nova:owner>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:user uuid="a4fd0ce3d79b409d92663d6a29453a9f">tempest-TestShelveInstance-1027914451-project-member</nova:user>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:project uuid="7379ac88a56148ac815c4343c79ee4bf">tempest-TestShelveInstance-1027914451</nova:project>
Jul 27 18:27:21 user nova-compute[71206]:       </nova:owner>
Jul 27 18:27:21 user nova-compute[71206]:       <nova:ports>
Jul 27 18:27:21 user nova-compute[71206]:         <nova:port uuid="c629fddc-5933-4f3e-b942-5cc4d8d1fded">
Jul 27 18:27:21 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 18:27:21 user nova-compute[71206]:         </nova:port>
Jul 27 18:27:21 user nova-compute[71206]:       </nova:ports>
Jul 27 18:27:21 user nova-compute[71206]:     </nova:instance>
Jul 27 18:27:21 user nova-compute[71206]:   </metadata>
Jul 27 18:27:21 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:27:21 user nova-compute[71206]:     <system>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="serial">6dd215bf-b46b-4d26-9169-db43d93b1f84</entry>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="uuid">6dd215bf-b46b-4d26-9169-db43d93b1f84</entry>
Jul 27 18:27:21 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:27:21 user nova-compute[71206]:     </system>
Jul 27 18:27:21 user nova-compute[71206]:   </sysinfo>
Jul 27 18:27:21 user nova-compute[71206]:   <os>
Jul 27 18:27:21 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:27:21 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:27:21 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:27:21 user nova-compute[71206]:   </os>
Jul 27 18:27:21 user nova-compute[71206]:   <features>
Jul 27 18:27:21 user nova-compute[71206]:     <acpi/>
Jul 27 18:27:21 user nova-compute[71206]:     <apic/>
Jul 27 18:27:21 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:27:21 user nova-compute[71206]:   </features>
Jul 27 18:27:21 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:27:21 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:27:21 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:27:21 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:27:21 user nova-compute[71206]:   </clock>
Jul 27 18:27:21 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:27:21 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:27:21 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:27:21 user nova-compute[71206]:   </cpu>
Jul 27 18:27:21 user nova-compute[71206]:   <devices>
Jul 27 18:27:21 user nova-compute[71206]:     <disk type="block" device="disk">
Jul 27 18:27:21 user nova-compute[71206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:27:21 user nova-compute[71206]:       <source dev="/dev/sdb"/>
Jul 27 18:27:21 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:27:21 user nova-compute[71206]:       <serial>a870ef49-1786-413b-a428-e13232fd1211</serial>
Jul 27 18:27:21 user nova-compute[71206]:     </disk>
Jul 27 18:27:21 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:27:21 user nova-compute[71206]:       <mac address="fa:16:3e:89:0a:03"/>
Jul 27 18:27:21 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:27:21 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:27:21 user nova-compute[71206]:       <target dev="tapc629fddc-59"/>
Jul 27 18:27:21 user nova-compute[71206]:     </interface>
Jul 27 18:27:21 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:27:21 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84/console.log" append="off"/>
Jul 27 18:27:21 user nova-compute[71206]:     </serial>
Jul 27 18:27:21 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:27:21 user nova-compute[71206]:     <video>
Jul 27 18:27:21 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:27:21 user nova-compute[71206]:     </video>
Jul 27 18:27:21 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:27:21 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:27:21 user nova-compute[71206]:     </rng>
Jul 27 18:27:21 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:27:21 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:27:21 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:27:21 user nova-compute[71206]:     </memballoon>
Jul 27 18:27:21 user nova-compute[71206]:   </devices>
Jul 27 18:27:21 user nova-compute[71206]: </domain>
Jul 27 18:27:21 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-790493354',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:27:11Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG os_vif [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc629fddc-59, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc629fddc-59, col_values=(('external_ids', {'iface-id': 'c629fddc-5933-4f3e-b942-5cc4d8d1fded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:0a:03', 'vm-uuid': '6dd215bf-b46b-4d26-9169-db43d93b1f84'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:21 user nova-compute[71206]: INFO os_vif [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59')
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:27:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] No VIF found with MAC fa:16:3e:89:0a:03, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:27:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:23 user nova-compute[71206]: WARNING nova.compute.manager [req-44302763-ae94-4309-b8fa-f791ca61e6f4 req-de7bf633-3331-48a8-8163-69aea1c2313e service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 18:27:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITgCfySc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:27:23 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:27:23 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:27:23 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe445c-2043-4889-97b9-7d13be2159df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:27:23 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab5c24-4214-4a84-a2a3-dd68fa305bec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2] added
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8d55bf-b0bd-4235-ab0d-7028a0418751]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ce622-5e3f-4ee7-b02c-4e7be59cd676]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITgCfySc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITgCfySc" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd6130c-fecb-48a9-b216-73b2621c8810]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITgCfySc'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9122cc36-2028-4461-89a7-7e045c785213]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efacf279-9ced-4808-af2e-665b23493933]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae2260-9fa5-4171-bad0-421c714b6f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260]
Jul 27 18:27:23 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260] successful.
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[896ff99b-0ad2-418e-b229-800795083a15]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e4002-228a-4579-94b7-c77df48e856a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:27:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cabd5a-5953-4d77-9bc7-14cef552a1a6]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:27:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITgCfySc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23730663966653563', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730663966653563', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:27:24 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:27:24 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:27:24 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:27:24 user nova-compute[71206]:   <serial>bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2</serial>
Jul 27 18:27:24 user nova-compute[71206]: </disk>
Jul 27 18:27:24 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] No VIF found with MAC fa:16:3e:7c:57:f7, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482444.957849, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:24 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Resumed (Lifecycle Event)
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:27:24 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance spawned successfully.
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:24 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:25 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:27:25 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482444.9644628, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:25 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Started (Lifecycle Event)
Jul 27 18:27:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f6395f7b-4e37-433b-9a10-25a7e5855ef2 tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.551s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-cb069c13-721e-495d-85c5-1b3debf91d2b tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.379s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:25 user nova-compute[71206]: WARNING nova.compute.manager [req-aa8d057e-b71b-479b-b884-d7de11cb4523 req-fb9d5993-00b7-4f3e-8edc-a7010575fa21 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state active and task_state None.
Jul 27 18:27:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:27 user nova-compute[71206]: DEBUG nova.compute.manager [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing instance network info cache due to event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:27:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:27 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:27 user nova-compute[71206]: DEBUG nova.network.neutron [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:27:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated VIF entry in instance network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:27:28 user nova-compute[71206]: DEBUG nova.network.neutron [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:28 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53e7039f-5429-44e6-b27d-1e36b652de15 req-fa442aee-3def-4104-b6f6-a284132a3394 service nova] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG nova.compute.manager [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing instance network info cache due to event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:29 user nova-compute[71206]: DEBUG nova.network.neutron [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:30 user nova-compute[71206]: INFO nova.compute.manager [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Rebooting instance
Jul 27 18:27:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated VIF entry in instance network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG nova.network.neutron [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53bb854a-4c7a-46bc-b0d7-cca0ddba7489 req-bd18e938-c2d7-4e49-98b3-9fa8adccd6a9 service nova] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG nova.network.neutron [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:30 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:33 user nova-compute[71206]: DEBUG nova.compute.manager [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:33 user nova-compute[71206]: WARNING nova.compute.manager [req-fed4ae0a-e2d7-4598-bdba-42e9c88d38e6 req-a1718cd3-1545-4c37-ac72-dd91eb40d12d service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state active and task_state reboot_started.
Jul 27 18:27:33 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance shutdown successfully.
Jul 27 18:27:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG nova.compute.manager [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:35 user nova-compute[71206]: WARNING nova.compute.manager [req-82e941b8-70b8-41b7-a902-2380200277d1 req-3b8963ff-f674-400a-8e96-f202ae674cb5 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state active and task_state reboot_started.
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:35 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Removed pending event for d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d due to event {{(pid=71206) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482457.3445392, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] VM Resumed (Lifecycle Event)
Jul 27 18:27:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance running successfully.
Jul 27 18:27:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance soft rebooted successfully.
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:37 user nova-compute[71206]: WARNING nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state active and task_state reboot_started.
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:27:37 user nova-compute[71206]: WARNING nova.compute.manager [req-5d510129-7b66-44fc-a311-db9ce849a2f7 req-c2843bdb-f9fc-4c31-91f0-5f4b64a9fbcd service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state active and task_state reboot_started.
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482457.3456223, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:27:37 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] VM Started (Lifecycle Event)
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a011fc7a-f271-48ad-b632-4628c5b34d3a tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.281s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:37 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:27:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:27:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.221179962158203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 68d73977-8546-42f6-9f90-f77b6163dbbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 6dd215bf-b46b-4d26-9169-db43d93b1f84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:27:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:27:47 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:27:47 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:27:47 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:27:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:27:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-changed-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG nova.compute.manager [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Refreshing instance network info cache due to event network-changed-2fbd37be-322e-47ad-bafe-8e95b843681d. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] Acquiring lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] Acquired lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Refreshing network info cache for port 2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updated VIF entry in instance network info cache for port 2fbd37be-322e-47ad-bafe-8e95b843681d. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG nova.network.neutron [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-5521ae88-95c5-42b0-9f8d-aeeb2f9216e5 req-12f6aecb-30e3-4419-beb0-05a26d486bb6 service nova] Releasing lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG nova.objects.instance [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:27:53 user nova-compute[71206]: INFO nova.compute.manager [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attaching volume 546e551f-994f-43fb-8593-4ec0245f8f73 to /dev/vdb
Jul 27 18:27:53 user nova-compute[71206]: DEBUG os_brick.utils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:27:53 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d264b25-5952-4d77-a0eb-3dc84a0a50c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cef17e-f384-4a50-8552-51f0b529663c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b4d40-a684-4130-b943-a344c63b8313]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6324715-1db7-458a-9884-d39a700a1d46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:27:54 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d26658-2e02-4184-b914-7236e3cd6db3]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG os_brick.utils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating existing volume attachment record: 40cf80e0-823c-41ef-8c36-4aef97029168 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:27:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:55 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:27:55 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:27:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:27:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:27:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:27:59 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:00 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:28:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaSJKBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:28:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:28:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:28:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:28:00 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:28:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:28:00 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:28:00 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:28:00 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77360df-dcac-4e8d-9e6c-c4fb5caa90ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:28:01 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57b754f-20fc-41a9-8192-d737bef532a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73] added
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea7032-4d6d-4c3f-b5ad-aeb805229a01]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d1f81c-e91d-4a04-a2e4-33c28b96b67d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaSJKBdz {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaSJKBdz" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da6cddd-0461-4a5d-9670-2f6a5b1a227a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HaSJKBdz'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1160f6-9c26-4956-8560-83f0b7894ebb]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c80ac-8f9a-4d71-8d0f-5007faa505f5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350f88a-744b-473a-ab28-9244f47e4b34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260]
Jul 27 18:28:01 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260] successful.
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b195b-fb52-4fcb-bf50-c72488ff0c2c]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ff002-b5ac-422b-854c-4f982b3f72f6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)
Jul 27 18:28:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[68001fac-a162-41ee-a67b-1bc42b94ce45]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:28:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaSJKBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23933643338396331', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643338396331', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:28:02 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:28:02 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:28:02 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:28:02 user nova-compute[71206]:   <serial>546e551f-994f-43fb-8593-4ec0245f8f73</serial>
Jul 27 18:28:02 user nova-compute[71206]: </disk>
Jul 27 18:28:02 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No VIF found with MAC fa:16:3e:08:d6:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:28:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-18132da5-fb5e-43ed-9a0d-a90ca9884005 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.936s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:28:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:11 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:28:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:28:21 user nova-compute[71206]: INFO nova.compute.manager [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Detaching volume 546e551f-994f-43fb-8593-4ec0245f8f73
Jul 27 18:28:21 user nova-compute[71206]: INFO nova.virt.block_device [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attempting to driver detach volume 546e551f-994f-43fb-8593-4ec0245f8f73 from mountpoint /dev/vdb
Jul 27 18:28:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Attempting to detach device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:28:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:28:21 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:28:21 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:28:21 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:28:21 user nova-compute[71206]:   <serial>546e551f-994f-43fb-8593-4ec0245f8f73</serial>
Jul 27 18:28:21 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:28:21 user nova-compute[71206]: </disk>
Jul 27 18:28:21 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:28:21 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config.
Jul 27 18:28:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:28:21 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:28:21 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:28:21 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:28:21 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:28:21 user nova-compute[71206]:   <serial>546e551f-994f-43fb-8593-4ec0245f8f73</serial>
Jul 27 18:28:21 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:28:21 user nova-compute[71206]: </disk>
Jul 27 18:28:21 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482502.434004, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:28:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config.
Jul 27 18:28:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaSJKBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:28:22 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14171aa1-0386-4df6-adef-f2088abcfddc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:28:22 user nova-compute[71206]: No targets found.
Jul 27 18:28:22 user nova-compute[71206]: iSNS:
Jul 27 18:28:22 user nova-compute[71206]: No targets found.
Jul 27 18:28:22 user nova-compute[71206]: STATIC:
Jul 27 18:28:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73
Jul 27 18:28:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:28:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:28:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2
Jul 27 18:28:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:28:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:28:22 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:28:22 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:28:22 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:28:22 user nova-compute[71206]: FIRMWARE:
Jul 27 18:28:22 user nova-compute[71206]: No targets found.
Jul 27 18:28:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:28:22 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:28:22 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee85d0-2ce5-4c4d-a040-65d56fd49dff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265d0f0-09b9-4942-9933-f65e9b97a63d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 (non-flash)
Jul 27 18:28:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e32936710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba601732-a953-41f7-b8e9-fc01ad616d9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371203f-1752-4c5e-815e-b11d68a9e7fc]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82355460-5e06-488e-96ed-064bbdd655a2]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10a7c6-7683-44fb-a2e2-d94e0943e4f8]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de26b985-7b8a-48bf-b8ba-5628ce0ec327]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c5ce22-2a3b-4e37-a1f0-3528f07e84c0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260]
Jul 27 18:28:22 user nova-compute[71206]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73, portal: 172.16.0.220,3260] successful.
Jul 27 18:28:22 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546e551f-994f-43fb-8593-4ec0245f8f73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f262e53a-7db8-4bff-b1d9-6a86fb084d2b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== disconnect_volume: return (295ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:28:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:28:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:28:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-d0ba08a3-7da2-4910-aa9d-3c21675af42f tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:28:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:26 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:28:31 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:36 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:28:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-changed-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.manager [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Refreshing instance network info cache due to event network-changed-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] Acquiring lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] Acquired lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.network.neutron [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Refreshing network info cache for port bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 18:28:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:28:46 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=25.219444274902344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 68d73977-8546-42f6-9f90-f77b6163dbbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 6dd215bf-b46b-4d26-9169-db43d93b1f84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:28:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:28:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updated VIF entry in instance network info cache for port bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:28:47 user nova-compute[71206]: DEBUG nova.network.neutron [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updating instance_info_cache with network_info: [{"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:28:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-0d9915c5-00ff-4f66-bda8-7d509fbcfadc req-4d479730-6145-4e86-9e81-9d5033d8ce18 service nova] Releasing lock "refresh_cache-68d73977-8546-42f6-9f90-f77b6163dbbd" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:28:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:28:50 user nova-compute[71206]: INFO nova.compute.manager [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Attaching volume 7636008a-dd30-43d2-bde3-48844b96edb5 to /dev/vdb
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.utils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6a36d-e0bd-4d47-8496-9c4901191d3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc08781-8caf-4536-abbc-9bd7a93ecf28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3112c27b-409e-40b5-a07e-32d5ed0518f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2709cee4-770f-4fc6-9581-c1e8bc7afc57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:28:50 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:28:50 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb8357-f341-4ab7-ab9f-a7f4f3cfcee7]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG os_brick.utils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:28:50 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updating existing volume attachment record: d66c3fb8-75e4-4c73-a120-4ecef8f2ed79 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:28:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:28:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:56 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryVwDluO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:28:57 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:28:57 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:28:57 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b05a97-dec8-4d46-b4d5-c62ff04cd4a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:28:57 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab68594-ae73-4d2b-b545-e17b12310ea1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5] added
Jul 27 18:28:57 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42088e35-0a96-4f8b-93c9-8bafc1fc3ad7]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f01f6-cec8-47a3-a5bf-ba42d091c786]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryVwDluO {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryVwDluO" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bfa14f-7857-47ea-9a56-0a100c00a6cc]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryVwDluO'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf73f99-d6dc-442f-9b8e-e0dfc2a90351]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35908b5-850d-4a5c-8935-9770b4eb0940]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:57 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:57 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:57 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:57 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:28:57 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --login" returned: 0 in 1.062s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bdc4b0-5f26-484e-b86f-b37ae953ceeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260]
Jul 27 18:28:58 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260] successful.
Jul 27 18:28:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e585c-6cdd-4639-8ce9-ec5d6ee2f333]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6207b136-99ca-4001-943b-1c48c11324ef]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)
Jul 27 18:28:58 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.280s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[738cce9a-ce0f-4916-9d4c-0332698360c2]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:28:58 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryVwDluO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.315s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== connect_volume: return (2316ms) {'type': 'block', 'scsi_wwn': '23638316235306364', 'path': '/dev/sdd'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638316235306364', 'path': '/dev/sdd'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:28:59 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:28:59 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:28:59 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:28:59 user nova-compute[71206]:   <serial>7636008a-dd30-43d2-bde3-48844b96edb5</serial>
Jul 27 18:28:59 user nova-compute[71206]: </disk>
Jul 27 18:28:59 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:28:59 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:14:65:b2, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:29:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6f2cab84-5dd8-4e72-903a-e95e5c07fef4 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.942s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:01 user nova-compute[71206]: INFO nova.compute.manager [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Detaching volume 7636008a-dd30-43d2-bde3-48844b96edb5
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: INFO nova.virt.block_device [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Attempting to driver detach volume 7636008a-dd30-43d2-bde3-48844b96edb5 from mountpoint /dev/vdb
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Attempting to detach device vdb from instance 68d73977-8546-42f6-9f90-f77b6163dbbd from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:01 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:01 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:29:01 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:01 user nova-compute[71206]:   <serial>7636008a-dd30-43d2-bde3-48844b96edb5</serial>
Jul 27 18:29:01 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:01 user nova-compute[71206]: </disk>
Jul 27 18:29:01 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance 68d73977-8546-42f6-9f90-f77b6163dbbd from the persistent domain config.
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68d73977-8546-42f6-9f90-f77b6163dbbd from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:01 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:01 user nova-compute[71206]:   <source dev="/dev/sdd"/>
Jul 27 18:29:01 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:01 user nova-compute[71206]:   <serial>7636008a-dd30-43d2-bde3-48844b96edb5</serial>
Jul 27 18:29:01 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:01 user nova-compute[71206]: </disk>
Jul 27 18:29:01 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing instance network info cache due to event network-changed-c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] Acquiring lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] Acquired lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.network.neutron [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Refreshing network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:01 user nova-compute[71206]: INFO nova.compute.manager [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Terminating instance
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482541.7841046, 68d73977-8546-42f6-9f90-f77b6163dbbd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:29:01 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance 68d73977-8546-42f6-9f90-f77b6163dbbd from the live domain config.
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryVwDluO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:01 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7926d2-e6c3-4dd8-8362-4c1969a20dc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:29:01 user nova-compute[71206]: No targets found.
Jul 27 18:29:01 user nova-compute[71206]: iSNS:
Jul 27 18:29:01 user nova-compute[71206]: No targets found.
Jul 27 18:29:01 user nova-compute[71206]: STATIC:
Jul 27 18:29:01 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2
Jul 27 18:29:01 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:01 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:01 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5
Jul 27 18:29:01 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:01 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:01 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:29:01 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:01 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:01 user nova-compute[71206]: FIRMWARE:
Jul 27 18:29:01 user nova-compute[71206]: No targets found.
Jul 27 18:29:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:29:01 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:29:01 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3781da1d-3a4d-4265-b3d2-da3d8a6a3c6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG nova.compute.manager [req-014ee5dd-bf64-447d-b4f3-d25508cd1480 req-de17374e-9860-4f1d-b883-3fd5ccbc61eb service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-unplugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec6bcd2-17c7-4abc-befd-d9fb8ca2320d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 (non-flash)
Jul 27 18:29:01 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c2c2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5'): ({'sdd'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Removing single pathed devices sdd {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ed056-3222-456d-a6c4-d62451d0f4d0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1571f8-6b96-43f5-970e-35f584c57408]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flushing IO for device /dev/sdd {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[566bb9d6-cc4a-4051-aa4a-d9ced30f9c34]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:29:01 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0525d9d-5d0a-4bce-92a4-4ed25533c2d8]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] SCSI volumes sdd have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad13306-d5ee-4410-b037-43ad808e0c1e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updated VIF entry in instance network info cache for port c629fddc-5933-4f3e-b942-5cc4d8d1fded. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.network.neutron [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [{"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f6d04804-386e-4d0b-83a5-21410b534d00 req-a2639640-c5b9-49ea-9191-6ab52445dda9 service nova] Releasing lock "refresh_cache-6dd215bf-b46b-4d26-9169-db43d93b1f84" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999a70d-559e-4691-8fcb-8ad73b4c8ef1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260]
Jul 27 18:29:02 user nova-compute[71206]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5, portal: 172.16.0.220,3260] successful.
Jul 27 18:29:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7636008a-dd30-43d2-bde3-48844b96edb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ed28d-ca7d-4818-bede-c7af2a08fcc4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== disconnect_volume: return (331ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:29:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Instance destroyed successfully.
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lazy-loading 'resources' on Instance uuid 6dd215bf-b46b-4d26-9169-db43d93b1f84 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T18:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1620571214',display_name='tempest-TestShelveInstance-server-1620571214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1620571214',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHByTdrbPvNU+FYPO7GCHIoA+gYrNi5eGFdXfKwb5kl6Wh0K8UP2nyuwGk3H2DbDjh1MWo7RilLfFzFurplP9RG03nMIVwJCuli9eIxZ5GmOnmBHaaG8y4xq2IdzIYt1Kw==',key_name='tempest-TestShelveInstance-790493354',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:27:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7379ac88a56148ac815c4343c79ee4bf',ramdisk_id='',reservation_id='r-ccirshve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1027914451',owner_user_name='tempest-TestShelveInstance-1027914451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:27:25Z,user_data=None,user_id='a4fd0ce3d79b409d92663d6a29453a9f',uuid=6dd215bf-b46b-4d26-9169-db43d93b1f84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converting VIF {"id": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "address": "fa:16:3e:89:0a:03", "network": {"id": "395c256c-c117-4146-93dd-9bf5cad16116", "bridge": "br-int", "label": "tempest-TestShelveInstance-672499504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7379ac88a56148ac815c4343c79ee4bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc629fddc-59", "ovs_interfaceid": "c629fddc-5933-4f3e-b942-5cc4d8d1fded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_vif [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc629fddc-59, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:02 user nova-compute[71206]: INFO os_vif [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:0a:03,bridge_name='br-int',has_traffic_filtering=True,id=c629fddc-5933-4f3e-b942-5cc4d8d1fded,network=Network(395c256c-c117-4146-93dd-9bf5cad16116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc629fddc-59')
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZFTPrgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:02 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24edbbf8-6eb0-4597-b4fc-7f899386aadd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:29:02 user nova-compute[71206]: No targets found.
Jul 27 18:29:02 user nova-compute[71206]: iSNS:
Jul 27 18:29:02 user nova-compute[71206]: No targets found.
Jul 27 18:29:02 user nova-compute[71206]: STATIC:
Jul 27 18:29:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2
Jul 27 18:29:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:02 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211
Jul 27 18:29:02 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:02 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:02 user nova-compute[71206]: FIRMWARE:
Jul 27 18:29:02 user nova-compute[71206]: No targets found.
Jul 27 18:29:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:29:02 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:29:02 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c9509-295a-49d1-a632-81411313bb7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018c9d8-20f5-4185-8074-128408d64853]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:29:02 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 (non-flash)
Jul 27 18:29:02 user nova-compute[71206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c2085e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106614d-2ce7-46ab-9a41-a153ca379c2b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e1163-49db-474c-b75f-abfa1df979d1]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[353dc016-0900-4145-b10c-6a32788c4a35]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ca588-45fa-40ff-a647-b2a78069baa2]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a0450d3f', '/dev/disk/by-id/scsi-1SCST_BIOa0450d3f-482ba5f67f3b20b4', '/dev/disk/by-id/scsi-23438326261356636') {{(pid=83159) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6686ae83-0286-4444-bead-84cd5895d81b]: (4, None) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fd48ea-379b-461a-8813-d0925be4b3a5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff2b86-62bc-40b2-9d23-69b67e16aeba]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260]
Jul 27 18:29:02 user nova-compute[71206]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211, portal: 172.16.0.220,3260] successful.
Jul 27 18:29:02 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a870ef49-1786-413b-a428-e13232fd1211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ee5ce3-cfcf-45c4-96bc-cd93204d3e06]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] <== disconnect_volume: return (310ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:29:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deleting instance files /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84_del
Jul 27 18:29:02 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deletion of /opt/stack/data/nova/instances/6dd215bf-b46b-4d26-9169-db43d93b1f84_del complete
Jul 27 18:29:02 user nova-compute[71206]: INFO nova.compute.manager [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG nova.objects.instance [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:02 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-bc1b34f1-70b9-4dc1-bfee-3933d0505138 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:03 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Took 0.42 seconds to deallocate network for instance.
Jul 27 18:29:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-c517c789-d2d5-4340-a76a-1e334f58dbf4 req-7109cf2d-0b60-4626-b169-72c902576b06 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-deleted-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:03 user nova-compute[71206]: INFO nova.compute.manager [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Took 0.71 seconds to detach 1 volumes for instance.
Jul 27 18:29:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Deleting volume: a870ef49-1786-413b-a428-e13232fd1211 {{(pid=71206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] Acquiring lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG nova.compute.manager [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] No waiting events found dispatching network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:29:03 user nova-compute[71206]: WARNING nova.compute.manager [req-05b14897-e3a2-4779-b745-afec3eaf321e req-84d7f21f-59ee-453c-9a86-c2a891e2a899 service nova] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Received unexpected event network-vif-plugged-c629fddc-5933-4f3e-b942-5cc4d8d1fded for instance with vm_state active and task_state deleting.
Jul 27 18:29:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:03 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:04 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:29:04 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:29:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:04 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Deleted allocations for instance 6dd215bf-b46b-4d26-9169-db43d93b1f84
Jul 27 18:29:04 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-2808d058-1508-4838-9e2c-4e1c44cab0fd tempest-TestShelveInstance-1027914451 tempest-TestShelveInstance-1027914451-project-member] Lock "6dd215bf-b46b-4d26-9169-db43d93b1f84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:29:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482542.3095303, 6dd215bf-b46b-4d26-9169-db43d93b1f84 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:29:17 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] VM Stopped (Lifecycle Event)
Jul 27 18:29:17 user nova-compute[71206]: DEBUG nova.compute.manager [None req-0e7fd293-1e6c-482b-afcd-be975a65d972 None None] [instance: 6dd215bf-b46b-4d26-9169-db43d93b1f84] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:29:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG nova.objects.instance [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:18 user nova-compute[71206]: INFO nova.compute.manager [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attaching volume d4d369c3-1c68-416a-b0da-62be86868030 to /dev/vdb
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.utils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a71c5-f90b-4981-9e2b-a4f69d7f5ff9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66857f88-625f-470c-a1e7-f8f0a53c7213]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f85801-9946-4ac9-9a5b-18730ba0334e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ef1e9-5a62-420d-89b4-d12e9f6555cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:29:18 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:29:18 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e470ff3-0a9a-4e92-8111-fa1bbfa09dc6]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG os_brick.utils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:18 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating existing volume attachment record: 3135930d-20fb-4892-9855-c196bc8fe317 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:29:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:21 user nova-compute[71206]: DEBUG nova.compute.manager [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing instance network info cache due to event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:29:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:29:21 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:29:21 user nova-compute[71206]: DEBUG nova.network.neutron [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated VIF entry in instance network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-23fe6666-1a0b-4528-b315-34b6c89e224e req-c16ef2d8-6118-4652-9a88-856c1ffc807c service nova] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.compute.manager [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing instance network info cache due to event network-changed-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] Acquiring lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] Acquired lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.network.neutron [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Refreshing network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:22 user nova-compute[71206]: INFO nova.compute.manager [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Detaching volume bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2
Jul 27 18:29:22 user nova-compute[71206]: INFO nova.virt.block_device [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Attempting to driver detach volume bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 from mountpoint /dev/vdb
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Attempting to detach device vdb from instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:22 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:22 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:29:22 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:22 user nova-compute[71206]:   <serial>bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2</serial>
Jul 27 18:29:22 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:22 user nova-compute[71206]: </disk>
Jul 27 18:29:22 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:22 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully detached device vdb from instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d from the persistent domain config.
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:29:22 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:22 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:22 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:29:22 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:22 user nova-compute[71206]:   <serial>bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2</serial>
Jul 27 18:29:22 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:22 user nova-compute[71206]: </disk>
Jul 27 18:29:22 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.network.neutron [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updated VIF entry in instance network info cache for port 1eb45c16-8329-400a-bdb0-64d4ca5bf9c6. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.network.neutron [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [{"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9404c9ff-5033-4e48-9ad4-6f9e23a5df67 req-85b686f4-8833-4208-8909-a8ff8ff8299a service nova] Releasing lock "refresh_cache-d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482563.287523, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:29:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully detached device vdb from instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d from the live domain config.
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITgCfySc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:23 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01cc515-adfc-46f0-896b-c86f284701fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:29:23 user nova-compute[71206]: No targets found.
Jul 27 18:29:23 user nova-compute[71206]: iSNS:
Jul 27 18:29:23 user nova-compute[71206]: No targets found.
Jul 27 18:29:23 user nova-compute[71206]: STATIC:
Jul 27 18:29:23 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2
Jul 27 18:29:23 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:23 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:23 user nova-compute[71206]: FIRMWARE:
Jul 27 18:29:23 user nova-compute[71206]: No targets found.
Jul 27 18:29:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:29:23 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:29:23 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53064843-caa4-4bc9-be85-3f7b0e5cca50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107d8a3-8a6b-40d4-a8a4-ae2fb20689b8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 (non-flash)
Jul 27 18:29:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24326e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a70b676-3ff7-448f-b30e-143d4ab66215]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a554b-2aab-4982-bcf8-1b9df874f919]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48685fc7-ac11-43e9-98f4-94b3ed640df4]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc674eed-a3ff-4270-83ff-96f73d4b003f]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c5c59-3910-429e-a57f-587db3c7d104]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6561dcb8-b358-490b-a845-2129d1375ca8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260]
Jul 27 18:29:23 user nova-compute[71206]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2, portal: 172.16.0.220,3260] successful.
Jul 27 18:29:23 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6d2c7d-ca9b-4f5b-ac90-a6fc924b4fb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ea5dc-6470-45d0-a50c-4acf3873d4d0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] <== disconnect_volume: return (282ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:29:24 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'flavor' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f403b36e-838d-40fa-891a-ef1b942d1c97 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:24 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWhQSmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:25 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d1fff-853f-4fe8-9f98-60241b1aa394]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:29:25 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c4b078-2361-49d1-8c0d-cd4919f0b054]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030] added
Jul 27 18:29:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cbc86d-349b-47fe-9624-7f767592b602]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8794cedb-2f72-46c7-b7a9-4a41cc338a34]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWhQSmys {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWhQSmys" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4148b1a-f906-4baf-919c-1bd4dc7cf0bf]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWhQSmys'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[117a9f40-079b-49e2-a9f3-14aa82c4db97]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d633cbc0-8d1f-4be6-b580-ed0a9237f118]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:29:25 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:29:25 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:25 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:29:25 user nova-compute[71206]: 
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed1462-3d78-48ce-aa0d-870de8e37df5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260]
Jul 27 18:29:25 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260] successful.
Jul 27 18:29:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[866dbfec-5446-4c1c-a285-cd56486a4c71]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a72e5-719f-4b8b-93d2-65d42eef247a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)
Jul 27 18:29:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)
Jul 27 18:29:25 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe93127b-dc96-4b62-8231-385a9bf9eb48]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:25 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWhQSmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26138323635663163', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323635663163', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.objects.instance [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:29:26 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:26 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:29:26 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:26 user nova-compute[71206]:   <serial>d4d369c3-1c68-416a-b0da-62be86868030</serial>
Jul 27 18:29:26 user nova-compute[71206]: </disk>
Jul 27 18:29:26 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No VIF found with MAC fa:16:3e:08:d6:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:29:26 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-24587f13-2323-4907-b341-89e1152ad009 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.711s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:29 user nova-compute[71206]: INFO nova.compute.manager [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Detaching volume d4d369c3-1c68-416a-b0da-62be86868030
Jul 27 18:29:29 user nova-compute[71206]: INFO nova.virt.block_device [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attempting to driver detach volume d4d369c3-1c68-416a-b0da-62be86868030 from mountpoint /dev/vdb
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Attempting to detach device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:29 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:29 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:29:29 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:29 user nova-compute[71206]:   <serial>d4d369c3-1c68-416a-b0da-62be86868030</serial>
Jul 27 18:29:29 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:29 user nova-compute[71206]: </disk>
Jul 27 18:29:29 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config.
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:29:29 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:29:29 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:29:29 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:29:29 user nova-compute[71206]:   <serial>d4d369c3-1c68-416a-b0da-62be86868030</serial>
Jul 27 18:29:29 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:29:29 user nova-compute[71206]: </disk>
Jul 27 18:29:29 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482569.9405577, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:29:29 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config.
Jul 27 18:29:29 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWhQSmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:29:29 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef578ce-b62b-4065-894d-62c13be90c9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:29:29 user nova-compute[71206]: No targets found.
Jul 27 18:29:29 user nova-compute[71206]: iSNS:
Jul 27 18:29:29 user nova-compute[71206]: No targets found.
Jul 27 18:29:29 user nova-compute[71206]: STATIC:
Jul 27 18:29:29 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030
Jul 27 18:29:29 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:29:29 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:29:29 user nova-compute[71206]: FIRMWARE:
Jul 27 18:29:29 user nova-compute[71206]: No targets found.
Jul 27 18:29:29 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:29:29 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:29:29 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:29:29 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2943517-e8cd-4f96-af0d-ac177847ba47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad4a17-73d6-489e-b177-6ce37b52f595]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)
Jul 27 18:29:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 (non-flash)
Jul 27 18:29:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e24325bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6a2229-239a-4778-b641-49baf412839a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca30f4-5143-4028-9501-13d3f7d252f1]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c142f7dc-73c6-4c8f-95e3-07032810ff2b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1405c04f-d5e4-41b9-8344-85526cf13ee8]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[483b2234-e705-486d-812c-4af8e6b24274]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea541117-cc29-471c-8718-d37d2ee649b4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260]
Jul 27 18:29:30 user nova-compute[71206]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030, portal: 172.16.0.220,3260] successful.
Jul 27 18:29:30 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d369c3-1c68-416a-b0da-62be86868030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45554d-c25c-4e10-94ac-f0af81932b6b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== disconnect_volume: return (300ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:29:30 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:29:31 user nova-compute[71206]: DEBUG nova.objects.instance [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:31 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-1e79cde6-f950-4eac-b7aa-e3eb86d07052 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:29:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:29:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=25.217391967773438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 68d73977-8546-42f6-9f90-f77b6163dbbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:29:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:49 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:51 user nova-compute[71206]: INFO nova.compute.manager [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Terminating instance
Jul 27 18:29:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-unplugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] No waiting events found dispatching network-vif-unplugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:29:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-b491a8cb-061c-421e-b9a6-36b14d9c2c63 req-f34c4be8-0cde-4292-ae75-f70a56163912 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-unplugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Instance destroyed successfully.
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'resources' on Instance uuid 68d73977-8546-42f6-9f90-f77b6163dbbd {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-47457381',display_name='tempest-AttachVolumeNegativeTest-server-47457381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-47457381',id=50,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmJobwJMN2cCfoY7zRtUouGtXXSS5dYjgO4nqQ3/4+eH2QDAsYR3bikJB7hEaY4yG8sQPMV1ZJU2sMrwd9lBEKZdaIeWSGtK1f9pt1qdAbfM7EE0on6v0TBmE/jDnJ4hA==',key_name='tempest-keypair-1635660845',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-df3fthhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=68d73977-8546-42f6-9f90-f77b6163dbbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "address": "fa:16:3e:14:65:b2", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2c70d4-4f", "ovs_interfaceid": "bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG os_vif [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb2c70d4-4f, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:29:52 user nova-compute[71206]: INFO os_vif [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2c70d4-4f')
Jul 27 18:29:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Deleting instance files /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd_del
Jul 27 18:29:52 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Deletion of /opt/stack/data/nova/instances/68d73977-8546-42f6-9f90-f77b6163dbbd_del complete
Jul 27 18:29:52 user nova-compute[71206]: INFO nova.compute.manager [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 27 18:29:52 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:29:52 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:53 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Took 1.03 seconds to deallocate network for instance.
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-0f5eaef6-70ff-4519-afff-339b6d9e7edb req-a9fd3de0-f15f-4606-a746-61fb5a205445 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-deleted-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:53 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Deleted allocations for instance 68d73977-8546-42f6-9f90-f77b6163dbbd
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-3a1e15b8-c40d-4fda-919d-685470a797ea tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] Acquiring lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] Lock "68d73977-8546-42f6-9f90-f77b6163dbbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:29:53 user nova-compute[71206]: DEBUG nova.compute.manager [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] No waiting events found dispatching network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:29:53 user nova-compute[71206]: WARNING nova.compute.manager [req-7de5e1cc-a9ac-4ca2-9310-36338be68663 req-a8fb813f-820a-4f69-a0b0-34bfeb84d671 service nova] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Received unexpected event network-vif-plugged-bb2c70d4-4fa7-47ab-b3dd-d656ec103e3e for instance with vm_state deleted and task_state None.
Jul 27 18:29:55 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:29:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:29:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:29:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:07 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482592.3218436, 68d73977-8546-42f6-9f90-f77b6163dbbd => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:30:07 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] VM Stopped (Lifecycle Event)
Jul 27 18:30:07 user nova-compute[71206]: DEBUG nova.compute.manager [None req-a235e5b3-dd5b-4760-b818-dc886f92c88f None None] [instance: 68d73977-8546-42f6-9f90-f77b6163dbbd] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:30:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:30:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:22 user nova-compute[71206]: INFO nova.compute.manager [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Terminating instance
Jul 27 18:30:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.compute.manager [req-53ebd3dc-7238-4795-b52f-a20c0bb8390b req-92b4d0a2-f6a3-4d94-939b-e810891e4415 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-unplugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Instance destroyed successfully.
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lazy-loading 'resources' on Instance uuid d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1850247517',display_name='tempest-TestMinimumBasicScenario-server-1850247517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1850247517',id=48,image_ref='a588d260-9b67-4193-b610-8d748b95954a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyq4NDlyQhTf8wi2hv73fQYxW5U+1Znva7YThlOCGf5H61FuYPJZZsvmVTwvyfcdzFgOzmzy+4+ZzKGrpIe9XN8hvZAPEFLx4eoyL2mdnfc2obK9qm1ApqlMhkDyH3Hwg==',key_name='tempest-TestMinimumBasicScenario-573478794',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a70697714134b96873b86f84ef10ffc',ramdisk_id='',reservation_id='r-iyytjtd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a588d260-9b67-4193-b610-8d748b95954a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-197547931',owner_user_name='tempest-TestMinimumBasicScenario-197547931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:27:37Z,user_data=None,user_id='671f2aec0ab2455cb24e10f5c726ecbb',uuid=d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converting VIF {"id": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "address": "fa:16:3e:7c:57:f7", "network": {"id": "a43648b1-1cdd-45db-9481-575ff3594657", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1346602056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a70697714134b96873b86f84ef10ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1eb45c16-83", "ovs_interfaceid": "1eb45c16-8329-400a-bdb0-64d4ca5bf9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG os_vif [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1eb45c16-83, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:23 user nova-compute[71206]: INFO os_vif [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=1eb45c16-8329-400a-bdb0-64d4ca5bf9c6,network=Network(a43648b1-1cdd-45db-9481-575ff3594657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1eb45c16-83')
Jul 27 18:30:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Deleting instance files /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d_del
Jul 27 18:30:23 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Deletion of /opt/stack/data/nova/instances/d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d_del complete
Jul 27 18:30:23 user nova-compute[71206]: INFO nova.compute.manager [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 18:30:23 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:30:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:24 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:30:24 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Took 0.48 seconds to deallocate network for instance.
Jul 27 18:30:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:24 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:30:24 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:30:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:24 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Deleted allocations for instance d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d
Jul 27 18:30:24 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c24b2a97-8d03-4a26-a9c0-36194e2ba773 tempest-TestMinimumBasicScenario-197547931 tempest-TestMinimumBasicScenario-197547931-project-member] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.711s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] Acquiring lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] Lock "d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] No waiting events found dispatching network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:30:25 user nova-compute[71206]: WARNING nova.compute.manager [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received unexpected event network-vif-plugged-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 for instance with vm_state deleted and task_state None.
Jul 27 18:30:25 user nova-compute[71206]: DEBUG nova.compute.manager [req-9d25e87d-103a-4f07-b5f3-50427fcb7216 req-78e04c9e-fe5b-4fb5-8dfe-fefb5ca6b085 service nova] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Received event network-vif-deleted-1eb45c16-8329-400a-bdb0-64d4ca5bf9c6 {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:25 user nova-compute[71206]: INFO nova.compute.manager [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attaching volume 5609c2ff-62df-4415-93bc-8c6d5f058aa7 to /dev/vdb
Jul 27 18:30:25 user nova-compute[71206]: DEBUG os_brick.utils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:30:25 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc8be7-4b48-4e5a-b6a4-f48f5d8e90b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3c74ed-f101-41e4-9414-872433c68ede]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ecc83-e577-46d5-944e-2eeb3e753c17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a71eb-4458-44ba-87ee-50ed82f69142]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:30:26 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:30:26 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76fd21-9144-45ab-8483-e8dd969a28ee]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG os_brick.utils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:30:26 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating existing volume attachment record: 0c3968c3-5956-4ce7-81a7-8ac25487f480 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:30:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:29 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqbgMckQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:30:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:30:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:30:32 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d63c71-b37c-4f6a-b363-1c49f5395740]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:30:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddc64b2-2e5a-4721-959e-6dacd7f678fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7] added
Jul 27 18:30:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230fd2e-d3f8-4423-ae25-7d84ec6cd56a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19feb181-9b79-4853-a62a-7ededffeab94]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqbgMckQ {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqbgMckQ" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e444856-4601-4b35-ae2c-95517c0110da]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqbgMckQ'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c9483-aec5-4009-a45b-09b129dab256]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a96f08-695d-4c1f-a755-23292b4facc9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:30:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:30:32 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:30:32 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:30:32 user nova-compute[71206]: 
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8fd8b-9fab-4594-87f4-5a9786e2e96a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260]
Jul 27 18:30:32 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260] successful.
Jul 27 18:30:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[02efa705-fd5e-47b0-90ef-77f86b8986e8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5a477e-0fb0-4dd1-91a9-ec98dddbbd13]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)
Jul 27 18:30:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)
Jul 27 18:30:32 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42794785-d578-43cd-a0cf-26d4ce311cd0]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:32 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqbgMckQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23665386563336535', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665386563336535', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG nova.objects.instance [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:33 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:30:33 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:30:33 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:30:33 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:30:33 user nova-compute[71206]:   <serial>5609c2ff-62df-4415-93bc-8c6d5f058aa7</serial>
Jul 27 18:30:33 user nova-compute[71206]: </disk>
Jul 27 18:30:33 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:30:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:30:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:30:34 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No VIF found with MAC fa:16:3e:08:d6:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:30:34 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-a54093f8-ccb3-4d4e-b5d9-879e95a7c875 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.504s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:37 user nova-compute[71206]: INFO nova.compute.manager [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Detaching volume 5609c2ff-62df-4415-93bc-8c6d5f058aa7
Jul 27 18:30:37 user nova-compute[71206]: INFO nova.virt.block_device [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attempting to driver detach volume 5609c2ff-62df-4415-93bc-8c6d5f058aa7 from mountpoint /dev/vdb
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Attempting to detach device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:30:37 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:30:37 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:30:37 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:30:37 user nova-compute[71206]:   <serial>5609c2ff-62df-4415-93bc-8c6d5f058aa7</serial>
Jul 27 18:30:37 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:30:37 user nova-compute[71206]: </disk>
Jul 27 18:30:37 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:30:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config.
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:30:37 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:30:37 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:30:37 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:30:37 user nova-compute[71206]:   <serial>5609c2ff-62df-4415-93bc-8c6d5f058aa7</serial>
Jul 27 18:30:37 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:30:37 user nova-compute[71206]: </disk>
Jul 27 18:30:37 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482637.5718305, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:30:37 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config.
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqbgMckQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:30:37 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd74adb-2d18-4e62-91a9-6201b18180a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:30:37 user nova-compute[71206]: No targets found.
Jul 27 18:30:37 user nova-compute[71206]: iSNS:
Jul 27 18:30:37 user nova-compute[71206]: No targets found.
Jul 27 18:30:37 user nova-compute[71206]: STATIC:
Jul 27 18:30:37 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7
Jul 27 18:30:37 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:30:37 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:30:37 user nova-compute[71206]: FIRMWARE:
Jul 27 18:30:37 user nova-compute[71206]: No targets found.
Jul 27 18:30:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:30:37 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:30:37 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5b618f-f953-496b-b0a7-878d0b36283e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a5838e-8118-41f2-952f-b4320d75d35d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)
Jul 27 18:30:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 (non-flash)
Jul 27 18:30:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c603ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3bbd32-eede-4358-8088-365cff601c43]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a109f-7918-40bd-bb94-4d73a298b8d6]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[35474ba0-34df-416f-8674-db537863735b]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aa0cd7-35d5-49ff-8027-5812ca625308]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b043b08f-5d0c-47ec-9000-4899a3f60316]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eabd66-ddf7-4d0c-a5ff-016a1959b247]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260]
Jul 27 18:30:37 user nova-compute[71206]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7, portal: 172.16.0.220,3260] successful.
Jul 27 18:30:37 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5609c2ff-62df-4415-93bc-8c6d5f058aa7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac3aa7-c245-4277-b4a2-788f3b3f896a]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== disconnect_volume: return (343ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:30:37 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:30:38 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482623.512255, d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:30:38 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] VM Stopped (Lifecycle Event)
Jul 27 18:30:38 user nova-compute[71206]: DEBUG nova.compute.manager [None req-351e7740-f4b7-44bf-814a-c80a612bdfe2 None None] [instance: d105a3cf-4e36-4dc7-8ce4-ae8d33f6577d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:30:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:30:38 user nova-compute[71206]: DEBUG nova.objects.instance [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:38 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-00f5f45c-b0f3-4dbc-8c3b-b4e027e0d31e tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Starting instance... {{(pid=71206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 18:30:45 user nova-compute[71206]: INFO nova.compute.claims [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Claim successful on node user
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Start building networks asynchronously for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Allocating IP information in the background. {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] allocate_for_instance() {{(pid=71206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 18:30:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Start building block device mappings for instance. {{(pid=71206) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.policy [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fb2e64d76d4952aed3839301da9af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d53f91aae484d95bb2a977e07116238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71206) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Start spawning the instance on the hypervisor. {{(pid=71206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Creating instance directory {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 18:30:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Creating image(s)
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "/opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "/opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.130s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "da3048b322b853339a66f20b8edbf8d038da81d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk 1073741824 {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1,backing_fmt=raw /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk 1073741824" returned: 0 in 0.050s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "da3048b322b853339a66f20b8edbf8d038da81d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1 --force-share --output=json" returned: 0 in 0.134s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk. size=1073741824 {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Successfully created port: ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.virt.disk.api [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Cannot resize image /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk to a smaller size. {{(pid=71206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'migration_context' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Created local disks {{(pid=71206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Ensure instance console log exists: /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/console.log {{(pid=71206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Successfully updated port: ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquired lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Building network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-changed-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.compute.manager [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Refreshing instance network info cache due to event network-changed-ede9d0b2-614d-4ede-bf67-042de9a149ce. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] Acquiring lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Instance cache missing network info. {{(pid=71206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:30:47 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.neutron [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating instance_info_cache with network_info: [{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:30:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:30:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=25.262935638427734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Releasing lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Instance network_info: |[{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] Acquired lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Refreshing network info cache for port ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Start _get_guest_xml network_info=[{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1bb2eba0-b0b8-44c8-a970-d8bda010fff6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 18:30:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:30:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller missing on host. {{(pid=71206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.host [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU controller found on host. {{(pid=71206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T17:55:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:55:45Z,direct_url=<?>,disk_format='qcow2',id=1bb2eba0-b0b8-44c8-a970-d8bda010fff6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c051be61314e4a00a452af401ae871b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image limits 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flavor pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Image pref 0:0:0 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Got 1 possible topologies {{(pid=71206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.hardware [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083251681',display_name='tempest-AttachVolumeNegativeTest-server-2083251681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083251681',id=51,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHyi4s16uLq7GVHu6mlTMsl5Mvlm+jev4XAQBb63w13zuDSgYUhqSQCBrap50qjeEi7b2leYdkJGeUu60e0G5C+5Mtq9NqYHC3/t0BrWj6/Io/3uajW906It8AV7JgQtQ==',key_name='tempest-keypair-693651136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-8b8pn35s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=e852abd4-641d-4793-b747-ce5ba80d118d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.objects.instance [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'pci_devices' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 18:30:48 user nova-compute[71206]:   <uuid>e852abd4-641d-4793-b747-ce5ba80d118d</uuid>
Jul 27 18:30:48 user nova-compute[71206]:   <name>instance-00000033</name>
Jul 27 18:30:48 user nova-compute[71206]:   <memory>524288</memory>
Jul 27 18:30:48 user nova-compute[71206]:   <vcpu>1</vcpu>
Jul 27 18:30:48 user nova-compute[71206]:   <metadata>
Jul 27 18:30:48 user nova-compute[71206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 18:30:48 user nova-compute[71206]:       <nova:package version="0.0.0"/>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2083251681</nova:name>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:creationTime>2023-07-27 18:30:48</nova:creationTime>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:flavor name="m1.tiny">
Jul 27 18:30:48 user nova-compute[71206]:         <nova:memory>512</nova:memory>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:disk>1</nova:disk>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:swap>0</nova:swap>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:vcpus>1</nova:vcpus>
Jul 27 18:30:48 user nova-compute[71206]:       </nova:flavor>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:owner>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:user uuid="75fb2e64d76d4952aed3839301da9af9">tempest-AttachVolumeNegativeTest-1298407279-project-member</nova:user>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:project uuid="9d53f91aae484d95bb2a977e07116238">tempest-AttachVolumeNegativeTest-1298407279</nova:project>
Jul 27 18:30:48 user nova-compute[71206]:       </nova:owner>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:root type="image" uuid="1bb2eba0-b0b8-44c8-a970-d8bda010fff6"/>
Jul 27 18:30:48 user nova-compute[71206]:       <nova:ports>
Jul 27 18:30:48 user nova-compute[71206]:         <nova:port uuid="ede9d0b2-614d-4ede-bf67-042de9a149ce">
Jul 27 18:30:48 user nova-compute[71206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 18:30:48 user nova-compute[71206]:         </nova:port>
Jul 27 18:30:48 user nova-compute[71206]:       </nova:ports>
Jul 27 18:30:48 user nova-compute[71206]:     </nova:instance>
Jul 27 18:30:48 user nova-compute[71206]:   </metadata>
Jul 27 18:30:48 user nova-compute[71206]:   <sysinfo type="smbios">
Jul 27 18:30:48 user nova-compute[71206]:     <system>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="product">OpenStack Nova</entry>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="version">0.0.0</entry>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="serial">e852abd4-641d-4793-b747-ce5ba80d118d</entry>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="uuid">e852abd4-641d-4793-b747-ce5ba80d118d</entry>
Jul 27 18:30:48 user nova-compute[71206]:       <entry name="family">Virtual Machine</entry>
Jul 27 18:30:48 user nova-compute[71206]:     </system>
Jul 27 18:30:48 user nova-compute[71206]:   </sysinfo>
Jul 27 18:30:48 user nova-compute[71206]:   <os>
Jul 27 18:30:48 user nova-compute[71206]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 18:30:48 user nova-compute[71206]:     <boot dev="hd"/>
Jul 27 18:30:48 user nova-compute[71206]:     <smbios mode="sysinfo"/>
Jul 27 18:30:48 user nova-compute[71206]:   </os>
Jul 27 18:30:48 user nova-compute[71206]:   <features>
Jul 27 18:30:48 user nova-compute[71206]:     <acpi/>
Jul 27 18:30:48 user nova-compute[71206]:     <apic/>
Jul 27 18:30:48 user nova-compute[71206]:     <vmcoreinfo/>
Jul 27 18:30:48 user nova-compute[71206]:   </features>
Jul 27 18:30:48 user nova-compute[71206]:   <clock offset="utc">
Jul 27 18:30:48 user nova-compute[71206]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 18:30:48 user nova-compute[71206]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 18:30:48 user nova-compute[71206]:     <timer name="hpet" present="no"/>
Jul 27 18:30:48 user nova-compute[71206]:   </clock>
Jul 27 18:30:48 user nova-compute[71206]:   <cpu mode="custom" match="exact">
Jul 27 18:30:48 user nova-compute[71206]:     <model>Nehalem</model>
Jul 27 18:30:48 user nova-compute[71206]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 18:30:48 user nova-compute[71206]:   </cpu>
Jul 27 18:30:48 user nova-compute[71206]:   <devices>
Jul 27 18:30:48 user nova-compute[71206]:     <disk type="file" device="disk">
Jul 27 18:30:48 user nova-compute[71206]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 18:30:48 user nova-compute[71206]:       <source file="/opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk"/>
Jul 27 18:30:48 user nova-compute[71206]:       <target dev="vda" bus="virtio"/>
Jul 27 18:30:48 user nova-compute[71206]:     </disk>
Jul 27 18:30:48 user nova-compute[71206]:     <interface type="ethernet">
Jul 27 18:30:48 user nova-compute[71206]:       <mac address="fa:16:3e:42:56:eb"/>
Jul 27 18:30:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:30:48 user nova-compute[71206]:       <mtu size="1442"/>
Jul 27 18:30:48 user nova-compute[71206]:       <target dev="tapede9d0b2-61"/>
Jul 27 18:30:48 user nova-compute[71206]:     </interface>
Jul 27 18:30:48 user nova-compute[71206]:     <serial type="pty">
Jul 27 18:30:48 user nova-compute[71206]:       <log file="/opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/console.log" append="off"/>
Jul 27 18:30:48 user nova-compute[71206]:     </serial>
Jul 27 18:30:48 user nova-compute[71206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 18:30:48 user nova-compute[71206]:     <video>
Jul 27 18:30:48 user nova-compute[71206]:       <model type="virtio"/>
Jul 27 18:30:48 user nova-compute[71206]:     </video>
Jul 27 18:30:48 user nova-compute[71206]:     <rng model="virtio">
Jul 27 18:30:48 user nova-compute[71206]:       <backend model="random">/dev/urandom</backend>
Jul 27 18:30:48 user nova-compute[71206]:     </rng>
Jul 27 18:30:48 user nova-compute[71206]:     <controller type="usb" index="0" model="none"/>
Jul 27 18:30:48 user nova-compute[71206]:     <memballoon model="virtio">
Jul 27 18:30:48 user nova-compute[71206]:       <stats period="10"/>
Jul 27 18:30:48 user nova-compute[71206]:     </memballoon>
Jul 27 18:30:48 user nova-compute[71206]:   </devices>
Jul 27 18:30:48 user nova-compute[71206]: </domain>
Jul 27 18:30:48 user nova-compute[71206]:  {{(pid=71206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083251681',display_name='tempest-AttachVolumeNegativeTest-server-2083251681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083251681',id=51,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHyi4s16uLq7GVHu6mlTMsl5Mvlm+jev4XAQBb63w13zuDSgYUhqSQCBrap50qjeEi7b2leYdkJGeUu60e0G5C+5Mtq9NqYHC3/t0BrWj6/Io/3uajW906It8AV7JgQtQ==',key_name='tempest-keypair-693651136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-8b8pn35s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T18:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=e852abd4-641d-4793-b747-ce5ba80d118d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG os_vif [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61') {{(pid=71206) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapede9d0b2-61, may_exist=True, interface_attrs={}) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapede9d0b2-61, col_values=(('external_ids', {'iface-id': 'ede9d0b2-614d-4ede-bf67-042de9a149ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:56:eb', 'vm-uuid': 'e852abd4-641d-4793-b747-ce5ba80d118d'}),), if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:48 user nova-compute[71206]: INFO os_vif [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61')
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:42:56:eb, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e852abd4-641d-4793-b747-ce5ba80d118d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updated VIF entry in instance network info cache for port ede9d0b2-614d-4ede-bf67-042de9a149ce. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG nova.network.neutron [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating instance_info_cache with network_info: [{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:30:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-f63bda15-81d6-4403-b80a-3c9b0a58f7b4 req-31e14795-77a0-4c5e-ad27-c3d50216a466 service nova] Releasing lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:49 user nova-compute[71206]: DEBUG nova.compute.manager [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:30:49 user nova-compute[71206]: WARNING nova.compute.manager [req-fbcd2420-6bd6-433b-921f-72773b584265 req-f55b61d4-5c71-44b0-8d65-c36d4a35cf73 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state building and task_state spawning.
Jul 27 18:30:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:50 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:50 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482651.6357255, e852abd4-641d-4793-b747-ce5ba80d118d => Resumed> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] VM Resumed (Lifecycle Event)
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Instance event wait completed in 0 seconds for  {{(pid=71206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Guest created on hypervisor {{(pid=71206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Instance spawned successfully.
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_cdrom_bus of ide {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_disk_bus of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_input_bus of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_pointer_model of None {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_video_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Found default for hw_vif_model of virtio {{(pid=71206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.virt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Emitting event <LifecycleEvent: 1690482651.637479, e852abd4-641d-4793-b747-ce5ba80d118d => Started> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] VM Started (Lifecycle Event)
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:30:51 user nova-compute[71206]: WARNING nova.compute.manager [req-ccee2f80-0df1-4266-b140-7b6ea61163aa req-75e9286c-92e7-4cc9-9f62-f3b4449b5e2a service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state building and task_state spawning.
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71206) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Took 6.01 seconds to spawn the instance on the hypervisor.
Jul 27 18:30:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 18:30:51 user nova-compute[71206]: INFO nova.compute.manager [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Took 6.53 seconds to build instance.
Jul 27 18:30:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-b8c0243f-7a4f-4252-959d-72f480151166 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.620s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:30:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:57 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:30:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:30:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:30:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:30:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:31:07 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:09 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:31:09 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:31:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:12 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:12 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:31:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:14 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:16 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:19 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:20 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG nova.objects.instance [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:31:33 user nova-compute[71206]: INFO nova.compute.manager [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attaching volume 3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 to /dev/vdb
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.utils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[850cdf9a-d5d1-4989-b3ae-874cf6fdabec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c6448-f266-407e-9196-0b8de5b96daa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39525948-45ad-4ee7-abb3-1d90e3cb0831]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2346b8e8-4b84-4b4b-a13c-6b006a9b24fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:31:33 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:31:33 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee9937-36da-447d-bf1a-3bb3dedd921a]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG os_brick.utils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:31:33 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating existing volume attachment record: 02ab9500-f4d1-4202-9a9e-a29be412b343 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:31:34 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXIowKnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:31:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:31:40 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:31:40 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9765e98-cc5c-405d-a887-d7ee0b84d544]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:31:40 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b419c-1843-4cf5-8ce4-8b45bbb0442f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538] added
Jul 27 18:31:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cba4d3-fdbc-4513-a588-51cceb67e7d5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d35437-dbaf-43e3-945a-299d7dde8841]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXIowKnC {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXIowKnC" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6517e90c-e774-48d9-875d-a5b7d126d428]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXIowKnC'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a84d6-43c2-4071-b909-b1b5b1cf5d18]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a964b-476b-4e04-9b3b-92ff95a33c87]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)
Jul 27 18:31:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)
Jul 27 18:31:40 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:31:40 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8951bdde-5726-4b3d-a13b-6a63b89f9e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260]
Jul 27 18:31:41 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260] successful.
Jul 27 18:31:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ceea73-33ed-4b62-8c0f-f8cfe8ec09e5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a7f89-51a3-4c70-a41b-2a81bb4e91db]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)
Jul 27 18:31:41 user nova-compute[71206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)
Jul 27 18:31:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec406fe-4812-4e08-acf9-072d75375ca2 (non-flash)
Jul 27 18:31:41 user nova-compute[71206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)
Jul 27 18:31:41 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef1568-4ae8-44ab-be27-75814a6076f6]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:31:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXIowKnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23866336338313836', 'path': '/dev/sdc'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866336338313836', 'path': '/dev/sdc'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:31:42 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:31:42 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:31:42 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:31:42 user nova-compute[71206]:   <serial>3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538</serial>
Jul 27 18:31:42 user nova-compute[71206]: </disk>
Jul 27 18:31:42 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] No VIF found with MAC fa:16:3e:08:d6:7c, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:31:42 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-dc926211-64c9-4960-874b-5fc5667de19a tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.961s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:31:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:31:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:31:44 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:31:44 user nova-compute[71206]: INFO nova.compute.manager [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Detaching volume 3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538
Jul 27 18:31:44 user nova-compute[71206]: INFO nova.virt.block_device [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Attempting to driver detach volume 3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 from mountpoint /dev/vdb
Jul 27 18:31:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Attempting to detach device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:31:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:31:44 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:31:44 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:31:44 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:31:44 user nova-compute[71206]:   <serial>3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538</serial>
Jul 27 18:31:44 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:31:44 user nova-compute[71206]: </disk>
Jul 27 18:31:44 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:31:44 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the persistent domain config.
Jul 27 18:31:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:31:44 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:31:44 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:31:44 user nova-compute[71206]:   <source dev="/dev/sdc"/>
Jul 27 18:31:44 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:31:44 user nova-compute[71206]:   <serial>3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538</serial>
Jul 27 18:31:44 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:31:44 user nova-compute[71206]: </disk>
Jul 27 18:31:44 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482705.3736546, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:31:45 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully detached device vdb from instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 from the live domain config.
Jul 27 18:31:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXIowKnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:31:45 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0575fa7-1a16-4aef-8ec3-e1f80638a481]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:31:45 user nova-compute[71206]: No targets found.
Jul 27 18:31:45 user nova-compute[71206]: iSNS:
Jul 27 18:31:45 user nova-compute[71206]: No targets found.
Jul 27 18:31:45 user nova-compute[71206]: STATIC:
Jul 27 18:31:45 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538
Jul 27 18:31:45 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:31:45 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:31:45 user nova-compute[71206]: FIRMWARE:
Jul 27 18:31:45 user nova-compute[71206]: No targets found.
Jul 27 18:31:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:31:45 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:31:45 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445f57f-0a90-44b1-b9a8-9f5ed815e488]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bca794-bc9e-4468-9e3c-da0993eafd36]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)
Jul 27 18:31:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 (non-flash)
Jul 27 18:31:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e0c51d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538'): ({'sdc'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Removing single pathed devices sdc {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760f9b1-4320-43a9-aac9-68ada6bd3802]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae20e4-9094-4549-9560-5083277211c5]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Flushing IO for device /dev/sdc {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1242a69-b3c9-44d6-a23e-b069dbfb9bef]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef95988-4b1d-408d-8a20-4bb50632bd99]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] SCSI volumes sdc have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1daa9b5-498a-44b5-8c9e-19f15fbec8bf]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38b1f6-6a9f-4b06-9c62-61d4e46f15c0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260]
Jul 27 18:31:45 user nova-compute[71206]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538, portal: 172.16.0.220,3260] successful.
Jul 27 18:31:45 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb0bbbd-2d8f-40bb-ab52-47a76b7e3538 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f810ba2-1f79-4b17-b50b-354e788d6d15]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] <== disconnect_volume: return (298ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:31:45 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:31:46 user nova-compute[71206]: DEBUG nova.objects.instance [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'flavor' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:31:46 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-5a545092-cd14-4e7c-a0dd-0d86e2052f05 tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.615s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:31:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:31:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:31:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.27212142944336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e852abd4-641d-4793-b747-ce5ba80d118d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:31:49 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:31:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:31:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.791s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:31:51 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:31:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:31:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.objects.instance [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lazy-loading 'info_cache' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [{"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-34dae52c-b14f-4d4b-a65c-236bea1f6731" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:31:58 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:31:59 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:08 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:13 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:32:18 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:23 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:28 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:33 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-changed-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG nova.compute.manager [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Refreshing instance network info cache due to event network-changed-ede9d0b2-614d-4ede-bf67-042de9a149ce. {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] Acquiring lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] Acquired lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG nova.network.neutron [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Refreshing network info cache for port ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG nova.network.neutron [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updated VIF entry in instance network info cache for port ede9d0b2-614d-4ede-bf67-042de9a149ce. {{(pid=71206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG nova.network.neutron [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating instance_info_cache with network_info: [{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:32:37 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-c31be316-58da-406c-8711-f60e1d1ff064 req-079d345e-c5a9-4907-a208-7313c4b60e84 service nova] Releasing lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:38 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:32:39 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:32:40 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:32:40 user nova-compute[71206]: INFO nova.compute.manager [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Attaching volume 36c99224-918f-4499-b0cf-81d8f37e5085 to /dev/vdb
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.utils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de029ba5-3c22-4aca-962c-06dd9e1d8361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6cdad17363f4\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab74909-ddd5-4d78-a1cd-d018eeb3f02b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3c585-651c-44cc-9012-cb6454885bed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b254455-0ddb-4fd2-981e-037d5fc82daa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Running cmd (subprocess): nvme version {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] 'nvme version' failed. Not Retrying. {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] nvme not present on system {{(pid=71206) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 18:32:41 user nova-compute[71206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 18:32:41 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea4b21-feac-4dc3-bf50-6f11c830092d]: (4, '') {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71206) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.lightos [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] LIGHTOS: no hostnqn found. {{(pid=71206) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG os_brick.utils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6cdad17363f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:32:41 user nova-compute[71206]: DEBUG nova.virt.block_device [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating existing volume attachment record: 542ca638-babf-413d-a0cb-bcf3cd81f3e3 {{(pid=71206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 18:32:43 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:44 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Calling os-brick to attach iSCSI Volume {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoHtVnQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:32:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:32:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:32:48 user nova-compute[71206]: INFO os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72667438-b205-4717-931b-1d5a73bfcae2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 18:32:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --interface default --op new {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac7af64-d33a-497e-b63b-ef94f526a261]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085] added\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085] added
Jul 27 18:32:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bef772-d221-4b2c-8670-ad1d98c907b8]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0be4d2-1a7c-4f69-862c-4efb54fd05c1]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoHtVnQY {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoHtVnQY" returned: 0 in 0.019s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282bdc1-d169-4c93-aaa2-44921db4cc77]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoHtVnQY'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246ef2f-a5fb-4237-a59b-d656e2bd4d6e]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9820ba8-1ff0-4414-8ae1-74780682e157]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:32:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 18:32:48 user nova-compute[71206]:  {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:32:48 user nova-compute[71206]: WARNING os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 18:32:48 user nova-compute[71206]: 
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --login {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d3333b-f165-414d-92af-fa60b69cc7f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260]
Jul 27 18:32:48 user nova-compute[71206]: Login to [iface: default, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260] successful.
Jul 27 18:32:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c21e4-b277-40bd-9678-7735fd89488d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b33cfc-816a-498e-a8d8-9632fe6c096e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)
Jul 27 18:32:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)
Jul 27 18:32:48 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to 172.16.0.220:3260 {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=71206) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71206) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d54317-7287-4054-a46d-591f9375847b]: (4, ('- - 0', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71206) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoHtVnQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71206) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:48 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71206) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:32:49 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.27065658569336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance 34dae52c-b14f-4d4b-a65c-236bea1f6731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Instance e852abd4-641d-4793-b747-ce5ba80d118d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23538643137303434', 'path': '/dev/sdb'} {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538643137303434', 'path': '/dev/sdb'} {{(pid=71206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.objects.instance [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:32:49 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 18:32:49 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:32:49 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:32:49 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:32:49 user nova-compute[71206]:   <serial>36c99224-918f-4499-b0cf-81d8f37e5085</serial>
Jul 27 18:32:49 user nova-compute[71206]: </disk>
Jul 27 18:32:49 user nova-compute[71206]:  {{(pid=71206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vda, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] No VIF found with MAC fa:16:3e:42:56:eb, not building metadata {{(pid=71206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-6779b463-06ae-4686-84e7-932c1154346b tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.226s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:32:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:32:50 user nova-compute[71206]: INFO nova.compute.manager [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Detaching volume 36c99224-918f-4499-b0cf-81d8f37e5085
Jul 27 18:32:51 user nova-compute[71206]: INFO nova.virt.block_device [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Attempting to driver detach volume 36c99224-918f-4499-b0cf-81d8f37e5085 from mountpoint /dev/vdb
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Attempting to detach device vdb from instance e852abd4-641d-4793-b747-ce5ba80d118d from the persistent domain config. {{(pid=71206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:32:51 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:32:51 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:32:51 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:32:51 user nova-compute[71206]:   <serial>36c99224-918f-4499-b0cf-81d8f37e5085</serial>
Jul 27 18:32:51 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:32:51 user nova-compute[71206]: </disk>
Jul 27 18:32:51 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:32:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance e852abd4-641d-4793-b747-ce5ba80d118d from the persistent domain config.
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e852abd4-641d-4793-b747-ce5ba80d118d from the live domain config. {{(pid=71206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.guest [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 18:32:51 user nova-compute[71206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 18:32:51 user nova-compute[71206]:   <source dev="/dev/sdb"/>
Jul 27 18:32:51 user nova-compute[71206]:   <target dev="vdb" bus="virtio"/>
Jul 27 18:32:51 user nova-compute[71206]:   <serial>36c99224-918f-4499-b0cf-81d8f37e5085</serial>
Jul 27 18:32:51 user nova-compute[71206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 18:32:51 user nova-compute[71206]: </disk>
Jul 27 18:32:51 user nova-compute[71206]:  {{(pid=71206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-7dfd98f2-841a-4cc2-b11d-7b76d9d1339a None None] Received event <DeviceRemovedEvent: 1690482771.5028644, e852abd4-641d-4793-b747-ce5ba80d118d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71206) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.driver [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 18:32:51 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully detached device vdb from instance e852abd4-641d-4793-b747-ce5ba80d118d from the live domain config.
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] calling os-brick to detach iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0e24135a20>, {'target_iqn': 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoHtVnQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 18:32:51 user nova-compute[71206]: WARNING os_brick.initiator.connectors.base [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db40d25a-c328-4543-bd31-d1ecc0fe8316]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 18:32:51 user nova-compute[71206]: No targets found.
Jul 27 18:32:51 user nova-compute[71206]: iSNS:
Jul 27 18:32:51 user nova-compute[71206]: No targets found.
Jul 27 18:32:51 user nova-compute[71206]: STATIC:
Jul 27 18:32:51 user nova-compute[71206]: Target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085
Jul 27 18:32:51 user nova-compute[71206]:         Portal: 172.16.0.220:3260,-1
Jul 27 18:32:51 user nova-compute[71206]:                 Iface Name: default
Jul 27 18:32:51 user nova-compute[71206]: FIRMWARE:
Jul 27 18:32:51 user nova-compute[71206]: No targets found.
Jul 27 18:32:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 18:32:51 user nova-compute[71206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 18:32:51 user nova-compute[71206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71206) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085', 0)] {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b570c6b-2cd6-47c8-a441-a2857daac121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73569fc3-dd4b-4984-920f-49e863f6c4da]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)
Jul 27 18:32:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 (non-flash)
Jul 27 18:32:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0e30343e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085'): ({'sdb'}, set())}) {{(pid=71206) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Removing single pathed devices sdb {{(pid=71206) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da68ddbd-581c-411f-874f-d1af1eeaea3c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b024dc-942a-402e-ba0b-2f571992f210]: (4, ('ok\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Flushing IO for device /dev/sdb {{(pid=71206) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93d840-c359-49a7-a5f9-0c228999a4f5]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71206) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a6caf-60ab-4c54-8e9d-f4d23afd29df]: (4, ('1', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.linuxscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] SCSI volumes sdb have been removed. {{(pid=71206) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085')] {{(pid=71206) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd72cb98-a2cc-4450-b8dd-83f671b64df0]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --logout {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48c99fd-8def-412e-8588-839d7036650d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260]
Jul 27 18:32:51 user nova-compute[71206]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085, portal: 172.16.0.220,3260] successful.
Jul 27 18:32:51 user nova-compute[71206]:  stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op delete {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36c99224-918f-4499-b0cf-81d8f37e5085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83159) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5481749b-b053-41b1-9f96-594163cc215d]: (4, ('', '')) {{(pid=83159) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71206) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.base [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] <== disconnect_volume: return (281ms) None {{(pid=71206) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 18:32:51 user nova-compute[71206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Disconnected iSCSI Volume {{(pid=71206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 18:32:52 user nova-compute[71206]: DEBUG nova.objects.instance [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'flavor' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:32:52 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-c6cffe59-15fc-4aee-a917-0927798a95e6 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:32:53 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:32:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:54 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:57 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:32:58 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:32:59 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:33:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 18:33:00 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquired lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 18:33:00 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Forcefully refreshing network info cache for instance {{(pid=71206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 18:33:01 user nova-compute[71206]: DEBUG nova.network.neutron [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating instance_info_cache with network_info: [{"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:33:01 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Releasing lock "refresh_cache-e852abd4-641d-4793-b747-ce5ba80d118d" {{(pid=71206) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 18:33:01 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updated the network info_cache for instance {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 18:33:01 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:06 user nova-compute[71206]: INFO nova.compute.manager [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Terminating instance
Jul 27 18:33:06 user nova-compute[71206]: DEBUG nova.compute.manager [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:06 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-unplugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] No waiting events found dispatching network-vif-unplugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.compute.manager [req-32e495a6-ccc1-4bb0-988d-e883a43ad4ce req-3cecc6c5-3e10-4af9-b398-cb3c42297ed7 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-unplugged-2fbd37be-322e-47ad-bafe-8e95b843681d for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Instance destroyed successfully.
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.objects.instance [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lazy-loading 'resources' on Instance uuid 34dae52c-b14f-4d4b-a65c-236bea1f6731 {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:25:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1430635865',display_name='tempest-SnapshotDataIntegrityTests-server-1430635865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1430635865',id=49,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDZcwtBMI18lFEv4wPNX7/QOtY8O4EOO2qkoyhR0wIe9ueJskqfG9LKB8Jpmuuuv+KItuhFFLCI4Vy8NBZKyEisHPjfiJLrDTUCwGgOG7gRVsVwpJZSyHGdsHldgR2TqQ==',key_name='tempest-keypair-438331228',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:26:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='341a42a81d70499e9d371d96ac63d09b',ramdisk_id='',reservation_id='r-c9arsqj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-970378017',owner_user_name='tempest-SnapshotDataIntegrityTests-970378017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1d522f91104d2b82563c667d798f7f',uuid=34dae52c-b14f-4d4b-a65c-236bea1f6731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converting VIF {"id": "2fbd37be-322e-47ad-bafe-8e95b843681d", "address": "fa:16:3e:08:d6:7c", "network": {"id": "dcadd059-9e43-42bc-8401-a065ff8605ee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2132528736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "341a42a81d70499e9d371d96ac63d09b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbd37be-32", "ovs_interfaceid": "2fbd37be-322e-47ad-bafe-8e95b843681d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG os_vif [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fbd37be-32, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:07 user nova-compute[71206]: INFO os_vif [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:d6:7c,bridge_name='br-int',has_traffic_filtering=True,id=2fbd37be-322e-47ad-bafe-8e95b843681d,network=Network(dcadd059-9e43-42bc-8401-a065ff8605ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbd37be-32')
Jul 27 18:33:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Deleting instance files /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731_del
Jul 27 18:33:07 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Deletion of /opt/stack/data/nova/instances/34dae52c-b14f-4d4b-a65c-236bea1f6731_del complete
Jul 27 18:33:07 user nova-compute[71206]: INFO nova.compute.manager [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 18:33:07 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:33:07 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:33:08 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:33:08 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Took 0.92 seconds to deallocate network for instance.
Jul 27 18:33:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:08 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:33:08 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:33:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:08 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Deleted allocations for instance 34dae52c-b14f-4d4b-a65c-236bea1f6731
Jul 27 18:33:08 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-04134d71-6f7f-4ad6-b5bf-53b05ca4099c tempest-SnapshotDataIntegrityTests-970378017 tempest-SnapshotDataIntegrityTests-970378017-project-member] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] Acquiring lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] Lock "34dae52c-b14f-4d4b-a65c-236bea1f6731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] No waiting events found dispatching network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:09 user nova-compute[71206]: WARNING nova.compute.manager [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received unexpected event network-vif-plugged-2fbd37be-322e-47ad-bafe-8e95b843681d for instance with vm_state deleted and task_state None.
Jul 27 18:33:09 user nova-compute[71206]: DEBUG nova.compute.manager [req-aeca3eca-7541-40a1-b172-88cec257614b req-299e0ee9-23cd-4429-86c9-e957281d68e2 service nova] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Received event network-vif-deleted-2fbd37be-322e-47ad-bafe-8e95b843681d {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:09 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:22 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482787.3966799, 34dae52c-b14f-4d4b-a65c-236bea1f6731 => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:33:22 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] VM Stopped (Lifecycle Event)
Jul 27 18:33:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-459515df-8ea9-4b54-b262-53c63f871000 None None] [instance: 34dae52c-b14f-4d4b-a65c-236bea1f6731] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:33:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:41 user nova-compute[71206]: INFO nova.compute.manager [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Terminating instance
Jul 27 18:33:41 user nova-compute[71206]: DEBUG nova.compute.manager [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Start destroying the instance on the hypervisor. {{(pid=71206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:41 user nova-compute[71206]: DEBUG nova.compute.manager [req-559118ac-0f84-4dc8-a191-438659c980ba req-5e0f2845-b3c7-426c-b0b1-c4d14b01cee2 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with task_state deleting. {{(pid=71206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Instance destroyed successfully.
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.objects.instance [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lazy-loading 'resources' on Instance uuid e852abd4-641d-4793-b747-ce5ba80d118d {{(pid=71206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.virt.libvirt.vif [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T18:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2083251681',display_name='tempest-AttachVolumeNegativeTest-server-2083251681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2083251681',id=51,image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHyi4s16uLq7GVHu6mlTMsl5Mvlm+jev4XAQBb63w13zuDSgYUhqSQCBrap50qjeEi7b2leYdkJGeUu60e0G5C+5Mtq9NqYHC3/t0BrWj6/Io/3uajW906It8AV7JgQtQ==',key_name='tempest-keypair-693651136',keypairs=<?>,launch_index=0,launched_at=2023-07-27T18:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d53f91aae484d95bb2a977e07116238',ramdisk_id='',reservation_id='r-8b8pn35s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1bb2eba0-b0b8-44c8-a970-d8bda010fff6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1298407279',owner_user_name='tempest-AttachVolumeNegativeTest-1298407279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T18:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fb2e64d76d4952aed3839301da9af9',uuid=e852abd4-641d-4793-b747-ce5ba80d118d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converting VIF {"id": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "address": "fa:16:3e:42:56:eb", "network": {"id": "ad85e98a-d269-490d-9c49-22fda43eef4a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810627517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d53f91aae484d95bb2a977e07116238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede9d0b2-61", "ovs_interfaceid": "ede9d0b2-614d-4ede-bf67-042de9a149ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.network.os_vif_util [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61') {{(pid=71206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG os_vif [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61') {{(pid=71206) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapede9d0b2-61, bridge=br-int, if_exists=True) {{(pid=71206) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:42 user nova-compute[71206]: INFO os_vif [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=ede9d0b2-614d-4ede-bf67-042de9a149ce,network=Network(ad85e98a-d269-490d-9c49-22fda43eef4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapede9d0b2-61')
Jul 27 18:33:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Deleting instance files /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d_del
Jul 27 18:33:42 user nova-compute[71206]: INFO nova.virt.libvirt.driver [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Deletion of /opt/stack/data/nova/instances/e852abd4-641d-4793-b747-ce5ba80d118d_del complete
Jul 27 18:33:42 user nova-compute[71206]: INFO nova.compute.manager [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 18:33:42 user nova-compute[71206]: DEBUG oslo.service.loopingcall [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71206) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.compute.manager [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Deallocating network for instance {{(pid=71206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] deallocate_for_instance() {{(pid=71206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.network.neutron [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Updating instance_info_cache with network_info: [] {{(pid=71206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 18:33:43 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Took 0.99 seconds to deallocate network for instance.
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-9df9a3b1-602a-457d-b09c-62eaa01850d6 req-aa9104fe-a18a-4352-a19c-df096ba6db63 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-deleted-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: INFO nova.scheduler.client.report [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Deleted allocations for instance e852abd4-641d-4793-b747-ce5ba80d118d
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-95ab76f0-7141-483b-aae9-483a778f5d50 tempest-AttachVolumeNegativeTest-1298407279 tempest-AttachVolumeNegativeTest-1298407279-project-member] Lock "e852abd4-641d-4793-b747-ce5ba80d118d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:43 user nova-compute[71206]: WARNING nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state deleted and task_state None.
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:43 user nova-compute[71206]: WARNING nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state deleted and task_state None.
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:43 user nova-compute[71206]: WARNING nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state deleted and task_state None.
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:43 user nova-compute[71206]: WARNING nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-unplugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state deleted and task_state None.
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Acquiring lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] Lock "e852abd4-641d-4793-b747-ce5ba80d118d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:43 user nova-compute[71206]: DEBUG nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] No waiting events found dispatching network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce {{(pid=71206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 18:33:43 user nova-compute[71206]: WARNING nova.compute.manager [req-88a71160-abf0-4dff-a5be-6d338902e8d4 req-d79bff06-a558-4ec8-9c57-d4cb083d5968 service nova] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Received unexpected event network-vif-plugged-ede9d0b2-614d-4ede-bf67-042de9a149ce for instance with vm_state deleted and task_state None.
Jul 27 18:33:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:33:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:33:48 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.325397491455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:33:48 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:52 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:33:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:57 user nova-compute[71206]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690482822.1056983, e852abd4-641d-4793-b747-ce5ba80d118d => Stopped> {{(pid=71206) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 18:33:57 user nova-compute[71206]: INFO nova.compute.manager [-] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] VM Stopped (Lifecycle Event)
Jul 27 18:33:57 user nova-compute[71206]: DEBUG nova.compute.manager [None req-680cc2fa-e1b9-4131-b2cf-90ed7291d526 None None] [instance: e852abd4-641d-4793-b747-ce5ba80d118d] Checking state {{(pid=71206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 18:33:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:33:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:33:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:34:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:34:00 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:34:00 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:01 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:03 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:34:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:34:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:49 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:34:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:34:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.315757751464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:34:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:34:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:53 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:53 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:34:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:34:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:34:59 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.002s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Verify base images {{(pid=71206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45
Jul 27 18:35:17 user nova-compute[71206]: WARNING nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Removable base files: /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28 /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991 /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9 /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45 /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/252cdbe45f9d27437ae676efb127282c43ceb9da
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5113ffe47beb05d7e4fd0142fd0fc36a9eae459c
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80387b7403b6d1e7f497791d5574d591f521533a
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/36c9a3166dce651c1378b44c6c3a477ef2b91aeb
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c5835b3308b1322d17550437233cd08f78d7df28
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5fc79a65a9d5245e21859fe67a113201f0a42991
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0bd6166a05f04e30f566b1fcb29c401df9ba0e8e
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c4c2c33523950b9bd7b106c843f498e97c1fcea9
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/403a58593f074c8b0113459b98e785cf4f33de45
Jul 27 18:35:17 user nova-compute[71206]: INFO nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da3048b322b853339a66f20b8edbf8d038da81d1
Jul 27 18:35:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Verification complete {{(pid=71206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Verify swap images {{(pid=71206) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 27 18:35:17 user nova-compute[71206]: DEBUG nova.virt.libvirt.imagecache [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Verify ephemeral images {{(pid=71206) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 27 18:35:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:35:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:35:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=25.31389617919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing inventories for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating ProviderTree inventory for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 18:35:50 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Updating inventory in ProviderTree for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing aggregate associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, aggregates: None {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Refreshing trait associations for resource provider 4946ae65-5eaf-4acb-8716-957c2a0b018d, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=71206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:35:51 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:55 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:35:55 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:35:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:35:58 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:01 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:02 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:03 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:36:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:36:03 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:36:04 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:14 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:14 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 18:36:15 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Cleaning up deleted instances {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 18:36:22 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] There are 0 instances to clean {{(pid=71206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 18:36:24 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:42 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:47 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Auditing locally available compute resources for user (node: user) {{(pid=71206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 18:36:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:36:50 user nova-compute[71206]: WARNING nova.virt.libvirt.driver [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.311466217041016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.provider_tree [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed in ProviderTree for provider: 4946ae65-5eaf-4acb-8716-957c2a0b018d {{(pid=71206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.scheduler.client.report [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Inventory has not changed for provider 4946ae65-5eaf-4acb-8716-957c2a0b018d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG nova.compute.resource_tracker [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Compute_service record updated for user:user {{(pid=71206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 18:36:50 user nova-compute[71206]: DEBUG oslo_concurrency.lockutils [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=71206) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 18:36:52 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:54 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:54 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 18:36:56 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:36:57 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:00 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:01 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:02 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:03 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:03 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:03 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:05 user nova-compute[71206]: DEBUG oslo_service.periodic_task [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71206) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 18:37:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Starting heal instance info cache {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 18:37:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Rebuilding the list of instances to heal {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 18:37:05 user nova-compute[71206]: DEBUG nova.compute.manager [None req-f719b274-a924-4c7a-8479-2defdb0b3b11 None None] Didn't find any instances for network info cache update. {{(pid=71206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:07 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:12 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:17 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:21 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:22 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:27 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71206) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71206) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 18:37:32 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 18:37:37 user nova-compute[71206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71206) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}